Jul 15 18:22:21 devstack cinder-volume[75856]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 15 18:22:21 devstack cinder-volume[75856]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 15 18:22:21 devstack cinder-volume[75856]: we strongly recommend against using it for new projects. Jul 15 18:22:21 devstack cinder-volume[75856]: If you are already using Eventlet, we recommend migrating to a different Jul 15 18:22:21 devstack cinder-volume[75856]: framework. For more detail see Jul 15 18:22:21 devstack cinder-volume[75856]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 15 18:22:21 devstack cinder-volume[75856]: import eventlet # noqa Jul 15 18:22:24 devstack cinder-volume[75856]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75856) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:22:24 devstack cinder-volume[75856]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75856) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:22:24 devstack cinder-volume[75856]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75856) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:22:25 devstack cinder-volume[75856]: INFO dbcounter [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Registered counter for database cinder Jul 15 18:22:25 devstack cinder-volume[75856]: DEBUG oslo_db.sqlalchemy.engines [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75856) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:22:25 devstack cinder-volume[75856]: DEBUG dbcounter [-] [75856] Writer thread running {{(pid=75856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 15 18:22:25 devstack cinder-volume[75856]: INFO cinder.rpc [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 15 18:22:25 devstack cinder-volume[75856]: INFO cinder.rpc [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 15 18:22:25 devstack cinder-volume[75856]: DEBUG oslo_db.sqlalchemy.engines [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75856) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:22:25 devstack cinder-volume[75856]: INFO cinder.volume.manager [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Determined volume DB was empty at startup. Jul 15 18:22:25 devstack cinder-volume[75856]: DEBUG cinder.volume.manager [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75856) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 15 18:22:25 devstack cinder-volume[75856]: INFO cinder.volume.manager [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 15 18:22:25 devstack cinder-volume[75856]: WARNING stevedore.named [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 15 18:22:26 devstack cinder-volume[75856]: WARNING castellan.key_manager [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:22:26 devstack cinder-volume[75856]: WARNING cinder.keymgr.conf_key_mgr [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG cinder.volume.drivers.lvm [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75856) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_concurrency.processutils [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_concurrency.processutils [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] CMD "cinder-rtstool verify" returned: 0 in 0.569s {{(pid=75856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_db.sqlalchemy.engines [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75856) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:22:26 devstack cinder-volume[75856]: INFO cinder.rpc [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 15 18:22:26 devstack cinder-volume[75856]: INFO cinder.rpc [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 15 18:22:26 devstack cinder-volume[75856]: WARNING stevedore.named [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 15 18:22:26 devstack cinder-volume[75856]: WARNING castellan.key_manager [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:22:26 devstack cinder-volume[75856]: INFO cinder.volume.manager [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_db.sqlalchemy.engines [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75856) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:22:26 devstack cinder-volume[75856]: INFO oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Starting 1 workers Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Started child 76044 {{(pid=75856) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Full set of CONF: {{(pid=75856) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] ******************************************************************************** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 15 18:22:26 devstack cinder-volume[76044]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Configuration options gathered from: {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] ================================================================================ {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] allow_availability_zone_fallback = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] allow_compression_on_image_upload = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] allowed_direct_url_schemes = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] api_rate_limit = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] auth_strategy = keystone {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] az_cache_duration = 3600 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_availability_zone = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_host = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_stats_polling_interval = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backup_api_class = cinder.backup.api.API {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backup_name_template = backup-%s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backup_use_same_host = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backup_use_temp_snapshot = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] chap_password = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] chap_username = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cinder_internal_tenant_project_id = 54335a6b570d4c3f8d4d0ef2adc0ec4f {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cinder_internal_tenant_user_id = 2926f17ef6374fb085d3794331af7ba6 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cloned_volume_same_az = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cluster = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] compression_format = gzip {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] compute_api_class = cinder.compute.nova.API {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] config_dir = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] config_source = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] control_exchange = openstack {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] debug = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] default_availability_zone = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] default_group_type = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] default_volume_type = lvmdriver-1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] disk_geometry = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] driver_client_cert = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] driver_client_cert_key = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] driver_data_namespace = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] driver_ssl_cert_path = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] driver_ssl_cert_verify = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] driver_use_ssl = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] enable_force_upload = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] enable_new_services = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] enable_unsupported_driver = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] enabled_backends = ['lvmdriver-1'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] enforce_multipath_for_image_xfer = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] filter_function = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance_api_insecure = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance_api_servers = ['http://192.168.122.218/image'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance_api_ssl_compression = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance_ca_certificates_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance_catalog_info = image:glance:publicURL {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance_certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance_keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance_num_retries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance_request_timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] goodness_function = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] graceful_shutdown_timeout = 5 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] group_api_class = cinder.group.api.API {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] host = devstack {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] image_compress_on_upload = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] image_conversion_address_space_limit = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] image_conversion_cpu_limit = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] image_conversion_disable = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] image_upload_use_cinder_backend = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] image_upload_use_internal_tenant = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] image_volume_cache_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] image_volume_cache_max_count = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] image_volume_cache_max_size_gb = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] init_host_max_objects_retrieval = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] instance_format = [instance: %(uuid)s] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] iscsi_target_flags = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] iscsi_write_cache = on {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] iser_helper = tgtadm {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] iser_ip_address = 192.168.122.218 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] iser_port = 3260 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] log_color = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] log_config_append = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] log_dir = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] log_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] log_options = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] log_rotate_interval = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] log_rotate_interval_type = days {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] log_rotation_type = none {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] max_age = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] max_logfile_count = 30 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] max_logfile_size_mb = 200 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] max_over_subscription_ratio = 20.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] message_reap_interval = 86400 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] message_ttl = 2592000 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] migration_create_volume_timeout_secs = 300 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] monkey_patch = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] monkey_patch_modules = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] my_ip = 192.168.122.218 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] no_snapshot_gb_quota = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] num_iser_scan_tries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] num_shell_tries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] num_volume_device_scan_tries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] nvmeof_conn_info_version = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] nvmet_ns_id = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] nvmet_port_id = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] osapi_max_limit = 1000 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] osapi_volume_ext_list = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] osapi_volume_listen = 0.0.0.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] osapi_volume_listen_port = 8776 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] osapi_volume_use_ssl = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] osapi_volume_workers = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] per_volume_size_limit = -1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] periodic_fuzzy_delay = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] periodic_interval = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] project_id_regex = [0-9a-f\-]+ {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] public_endpoint = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] publish_errors = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] quota_backup_gigabytes = 1000 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] quota_backups = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] quota_gigabytes = 1000 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] quota_groups = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] quota_snapshots = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] quota_volumes = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] rate_limit_burst = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] rate_limit_except_level = CRITICAL {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] rate_limit_interval = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] reinit_driver_count = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] replication_device = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] report_discard_supported = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] report_interval = 120 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] reservation_clean_interval = 86400 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] reservation_expire = 86400 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] reserved_image_namespaces = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] reserved_percentage = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] rpc_response_timeout = 120 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] run_external_periodic_tasks = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] scst_target_driver = iscsi {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] scst_target_iqn_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] service_down_time = 720 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] shell_completion = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] snapshot_name_template = snapshot-%s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] snapshot_same_host = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] split_loggers = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] state_path = /opt/stack/data/cinder {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] storage_availability_zone = nova {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] storage_protocol = iSCSI {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] syslog_log_facility = LOG_USER {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] target_helper = lioadm {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] target_ip_address = 192.168.122.218 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] target_port = 3260 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] target_protocol = iscsi {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] target_secondary_ip_addresses = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] trace_flags = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] transfer_api_class = cinder.transfer.api.API {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] transport_url = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] until_refresh = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] use_chap_auth = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] use_default_quota_class = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] use_journal = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] use_json = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] use_multipath_for_image_xfer = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] use_stderr = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] use_syslog = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] verify_glance_signatures = enabled {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volume_api_class = cinder.volume.api.API {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volume_backend_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volume_clear = zero {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volume_clear_ionice = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volume_clear_size = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volume_copy_bps_limit = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volume_dd_blocksize = 1M {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volume_name_template = volume-%s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volume_service_inithost_offload = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volume_usage_audit_period = month {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] zoning_mode = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:22:26 devstack cinder-volume[76044]: INFO cinder.volume.manager [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_concurrency.disable_process_locking = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.auth_section = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.auth_type = password {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.auth_version = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.cache = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.delay_auth_decision = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.http_connect_timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.include_service_catalog = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.insecure = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.interface = public {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_password = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcache_username = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.region_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.service_token_roles_required = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.service_type = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.token_cache_time = 300 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.218/identity {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.backend = dogpile.cache.null {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.backend_argument = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.backend_expiration_time = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.config_prefix = cache.oslo {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.debug_cache_backend = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.enable_retry_client = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.enable_socket_keepalive = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.expiration_time = 600 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.hashclient_retry_attempts = 2 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.memcache_dead_retry = 300 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.memcache_pool_maxsize = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.memcache_sasl_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.password = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.proxies = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.redis_db = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.redis_sentinel_service_name = mymaster {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.redis_server = localhost:6379 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.retry_attempts = 2 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.retry_delay = 0.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.socket_keepalive_count = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.socket_keepalive_idle = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.socket_keepalive_interval = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.socket_timeout = 1.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.tls_allowed_ciphers = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.tls_cafile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.tls_certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.tls_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.tls_keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cache.username = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:26 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] coordination.backend_url = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.asyncio_connection = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.asyncio_slave_connection = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.backend = sqlalchemy {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.connection = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.connection_debug = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.connection_parameters = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.connection_recycle_time = 3600 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.connection_trace = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.db_inc_retry_interval = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.db_max_retries = 20 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.db_max_retry_interval = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.db_retry_interval = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.max_overflow = 50 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.max_pool_size = 5 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.max_retries = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.mysql_wsrep_sync_wait = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.pool_timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.retry_interval = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.slave_connection = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.sqlite_synchronous = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.synchronous_reader = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] database.use_db_reconnect = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler.connection_string = messaging:// {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler.enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler.es_doc_type = notification {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler.es_scroll_size = 10000 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler.es_scroll_time = 2m {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler.filter_error_trace = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler.hmac_keys = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler.sentinel_service_name = mymaster {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler.socket_timeout = 0.1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler.trace_requests = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler.trace_sqlalchemy = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler_jaeger.process_tags = {} {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler_jaeger.service_name_prefix = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] profiler_otlp.service_name_prefix = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_policy.enforce_new_defaults = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_policy.enforce_scope = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_policy.policy_default_rule = default {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_policy.policy_file = policy.yaml {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_policy.remote_timeout = 60.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] privsep_osbrick.group = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] privsep_osbrick.helper_command = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] privsep_osbrick.user = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cinder_sys_admin.group = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cinder_sys_admin.helper_command = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] cinder_sys_admin.user = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] service_user.auth_section = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] service_user.auth_type = password {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] service_user.cafile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] service_user.certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] service_user.collect_timing = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] service_user.insecure = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] service_user.keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] service_user.send_service_user_token = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] service_user.split_loggers = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] service_user.timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance.auth_section = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance.auth_type = password {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance.certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance.collect_timing = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance.insecure = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance.keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance.region_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance.split_loggers = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] glance.timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.backend_availability_zone = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.chap_password = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.chap_username = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.disk_geometry = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.driver_client_cert = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.driver_client_cert_key = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.driver_data_namespace = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.driver_use_ssl = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.enable_unsupported_driver = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.extra_capabilities = {} {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.filter_function = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.goodness_function = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.iscsi_target_flags = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.iscsi_write_cache = on {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.iser_helper = tgtadm {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.iser_ip_address = 192.168.122.218 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.iser_port = 3260 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.lvm_mirrors = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.lvm_share_target = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.lvm_type = auto {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.num_shell_tries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.nvmet_port_id = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.replication_device = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.report_discard_supported = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.reserved_percentage = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.scst_target_driver = iscsi {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.scst_target_iqn_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.storage_protocol = iSCSI {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.target_helper = tgtadm {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.target_ip_address = 192.168.122.218 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.target_port = 3260 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.target_protocol = iscsi {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.trace_flags = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.unique_fqdn_network = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.use_chap_auth = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.volume_backend_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.volume_clear = zero {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.volume_clear_ionice = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.volume_clear_size = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.volume_group = cinder-volumes {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_reports.file_event_handler = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_reports.log_dir = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.backend_availability_zone = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.backend_host = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.chap_password = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.chap_username = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.chiscsi_conf = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.disk_geometry = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.driver_client_cert = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.driver_data_namespace = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.driver_use_ssl = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.extra_capabilities = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.filter_function = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.goodness_function = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.iser_helper = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.iser_ip_address = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.iser_port = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.iser_target_prefix = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.lvm_conf_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.lvm_mirrors = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.lvm_share_target = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.lvm_type = auto {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.num_shell_tries = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.nvmet_port_id = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.replication_device = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.report_discard_supported = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.reserved_percentage = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.scst_target_driver = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.storage_protocol = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.target_helper = lioadm {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.target_ip_address = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.target_port = 3260 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.target_protocol = iscsi {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.trace_flags = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.use_chap_auth = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack sudo[76048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:27 devstack sudo[76048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.volume_clear = zero {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.volume_clear_size = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] lvmdriver-1.volumes_dir = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.ssl = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.ssl_version = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_notifications.driver = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_notifications.retry = -1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] oslo_messaging_notifications.transport_url = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] key_manager.fixed_key = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.barbican_api_version = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.barbican_endpoint = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.barbican_endpoint_type = public {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.barbican_region_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.cafile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.collect_timing = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.insecure = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.number_of_retries = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.retry_delay = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.send_service_user_token = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.split_loggers = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.verify_ssl = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican.verify_ssl_path = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican_service_user.auth_section = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican_service_user.auth_type = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican_service_user.cafile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican_service_user.certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican_service_user.collect_timing = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican_service_user.insecure = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican_service_user.keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican_service_user.split_loggers = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] barbican_service_user.timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.approle_role_id = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.approle_secret_id = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.auth_method = approle {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.auth_path = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.kv_mountpoint = secret {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.kv_path = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.kv_version = 2 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.namespace = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.root_token_id = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.ssl_ca_crt_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.timeout = 60.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.token_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.token_role = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.use_ssl = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:22:27 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] ******************************************************************************** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 15 18:22:27 devstack sudo[76048]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:27 devstack sudo[76051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:27 devstack sudo[76051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:27 devstack sudo[76051]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.255s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:22:27 devstack cinder-volume[76044]: INFO cinder.brick.local_dev.lvm [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:27 devstack sudo[76131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:22:27 devstack sudo[76131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:27 devstack sudo[76131]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG cinder.brick.local_dev.lvm [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76044) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 15 18:22:27 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:27 devstack sudo[76234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:27 devstack sudo[76234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:28 devstack sudo[76234]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:28 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.521s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:28 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:28 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:28 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:28 devstack sudo[76438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:28 devstack sudo[76438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:28 devstack sudo[76438]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:28 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:28 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:28 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:28 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:28 devstack sudo[76531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 15 18:22:28 devstack sudo[76531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:28 devstack sudo[76531]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:28 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.259s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:28 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:28 devstack sudo[76631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:22:28 devstack sudo[76631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:29 devstack sudo[76631]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:29 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:29 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:29 devstack sudo[76660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:22:29 devstack sudo[76660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:29 devstack sudo[76660]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:29 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:29 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:29 devstack sudo[76704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:29 devstack sudo[76704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:29 devstack sudo[76704]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:29 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:29 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:29 devstack sudo[76746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:29 devstack sudo[76746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:30 devstack sudo[76746]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:30 devstack sudo[76756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:30 devstack sudo[76756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:30 devstack sudo[76756]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.317s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:30 devstack cinder-volume[76044]: INFO cinder.volume.drivers.lvm [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:30 devstack sudo[76840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:30 devstack sudo[76840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:30 devstack sudo[76840]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG cinder.volume.drivers.lvm [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Updating volume stats {{(pid=76044) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:30 devstack sudo[76843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:22:30 devstack sudo[76843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:30 devstack sudo[76843]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:30 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:30 devstack sudo[76846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:30 devstack sudo[76846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:31 devstack sudo[76846]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:31 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:31 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:31 devstack sudo[76849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:31 devstack sudo[76849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:31 devstack sudo[76849]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:31 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:31 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:31 devstack sudo[76852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:31 devstack sudo[76852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:31 devstack sudo[76852]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:31 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:31 devstack cinder-volume[76044]: INFO cinder.volume.driver [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Driver hasn't implemented _init_vendor_properties() Jul 15 18:22:31 devstack cinder-volume[76044]: DEBUG cinder.volume.driver [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76044) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 15 18:22:31 devstack cinder-volume[76044]: DEBUG oslo_db.sqlalchemy.engines [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:22:31 devstack cinder-volume[76044]: DEBUG dbcounter [-] [76044] Writer thread running {{(pid=76044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 15 18:22:31 devstack cinder-volume[76044]: DEBUG cinder.db.api [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Building query based on filter {{(pid=76044) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 15 18:22:31 devstack cinder-volume[76044]: DEBUG cinder.image.image_utils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76044) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 15 18:22:31 devstack cinder-volume[76044]: INFO cinder.keymgr.migration [None req-0d976023-9f0f-414f-9c3f-04d35efd706a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 15 18:22:31 devstack cinder-volume[76044]: DEBUG cinder.volume.drivers.lvm [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Updating volume stats {{(pid=76044) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:22:31 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:31 devstack sudo[76857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:22:31 devstack sudo[76857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:32 devstack sudo[76857]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:32 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:32 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:32 devstack sudo[76860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:32 devstack sudo[76860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:32 devstack sudo[76860]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:32 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:32 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:32 devstack sudo[76865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:32 devstack sudo[76865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:32 devstack sudo[76865]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:32 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:32 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:32 devstack sudo[76868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:32 devstack sudo[76868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:32 devstack sudo[76868]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:32 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:33 devstack cinder-volume[76044]: DEBUG cinder.manager [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Notifying Schedulers of capabilities ... {{(pid=76044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:22:33 devstack cinder-volume[76044]: INFO cinder.volume.manager [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Driver initialization completed successfully. Jul 15 18:22:33 devstack cinder-volume[76044]: INFO cinder.manager [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Initiating service 2 cleanup Jul 15 18:22:33 devstack cinder-volume[76044]: INFO cinder.manager [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Service 2 cleanup completed. Jul 15 18:22:33 devstack cinder-volume[76044]: DEBUG cinder.service [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Creating RPC server for service cinder-volume {{(pid=76044) start /opt/stack/cinder/cinder/service.py:231}} Jul 15 18:22:33 devstack cinder-volume[76044]: DEBUG cinder.service [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76044) start /opt/stack/cinder/cinder/service.py:237}} Jul 15 18:22:33 devstack cinder-volume[76044]: INFO cinder.volume.manager [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 15 18:22:33 devstack cinder-volume[76044]: DEBUG cinder.volume.drivers.lvm [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Updating volume stats {{(pid=76044) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:22:33 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:33 devstack sudo[76877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:22:33 devstack sudo[76877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:33 devstack sudo[76877]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:33 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:33 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:33 devstack sudo[76882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:33 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:33 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:33 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:33 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:33 devstack sudo[76885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:22:33 devstack sudo[76885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:34 devstack sudo[76885]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:34 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.321s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:34 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:22:34 devstack sudo[76888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:22:34 devstack sudo[76888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:22:34 devstack sudo[76888]: pam_unix(sudo:session): session closed for user root Jul 15 18:22:34 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:22:34 devstack cinder-volume[76044]: INFO cinder.volume.manager [None req-d695ee50-bbc0-4e61-b098-d3d78b8d2082 None None] Driver post RPC initialization completed successfully. Jul 15 18:22:36 devstack cinder-volume[75856]: DEBUG dbcounter [-] [75856] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:22:43 devstack cinder-volume[76044]: DEBUG dbcounter [-] [76044] Writing DB stats cinder:SELECT=4 {{(pid=76044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:22:44 devstack cinder-volume[76044]: DEBUG dbcounter [-] [76044] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:23:23 devstack cinder-volume[76044]: DEBUG oslo_service.periodic_task [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running periodic task VolumeManager._thread_info {{(pid=76044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:23:23 devstack cinder-volume[76044]: DEBUG cinder.volume.manager [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] thread count: 6 {{(pid=76044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:23:23 devstack cinder-volume[76044]: DEBUG cinder.volume.manager [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] thread info: [<_MainThread(MainThread, started 125086909124736)>, , , , , ] {{(pid=76044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:24:23 devstack cinder-volume[76044]: DEBUG oslo_service.periodic_task [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:24:23 devstack cinder-volume[76044]: DEBUG cinder.volume.drivers.lvm [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Updating volume stats {{(pid=76044) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:24:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:24:23 devstack sudo[82080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:24:23 devstack sudo[82080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:24:23 devstack sudo[82080]: pam_unix(sudo:session): session closed for user root Jul 15 18:24:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:24:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:24:23 devstack sudo[82083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:24:23 devstack sudo[82083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:24:23 devstack sudo[82083]: pam_unix(sudo:session): session closed for user root Jul 15 18:24:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:24:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:24:23 devstack sudo[82086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:24:23 devstack sudo[82086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:24:24 devstack sudo[82086]: pam_unix(sudo:session): session closed for user root Jul 15 18:24:24 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:24:24 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:24:24 devstack sudo[82089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:24:24 devstack sudo[82089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:24:24 devstack sudo[82089]: pam_unix(sudo:session): session closed for user root Jul 15 18:24:24 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:24:24 devstack cinder-volume[76044]: DEBUG cinder.manager [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Notifying Schedulers of capabilities ... {{(pid=76044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:24:24 devstack cinder-volume[76044]: DEBUG oslo_service.periodic_task [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running periodic task VolumeManager._thread_info {{(pid=76044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:24:24 devstack cinder-volume[76044]: DEBUG cinder.volume.manager [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] thread count: 6 {{(pid=76044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:24:24 devstack cinder-volume[76044]: DEBUG cinder.volume.manager [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] thread info: [<_MainThread(MainThread, started 125086909124736)>, , , , , ] {{(pid=76044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:24:44 devstack cinder-volume[76044]: DEBUG dbcounter [-] [76044] Writing DB stats cinder:SELECT=1 {{(pid=76044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:24:44 devstack cinder-volume[76044]: DEBUG dbcounter [-] [76044] Writing DB stats cinder:UPDATE=1 {{(pid=76044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:25:23 devstack cinder-volume[76044]: DEBUG oslo_service.periodic_task [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:25:23 devstack cinder-volume[76044]: DEBUG cinder.volume.drivers.lvm [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Updating volume stats {{(pid=76044) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:25:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:25:23 devstack sudo[84154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:25:23 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:25:23 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root Jul 15 18:25:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:25:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:25:23 devstack sudo[84162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:25:23 devstack sudo[84162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:25:23 devstack sudo[84162]: pam_unix(sudo:session): session closed for user root Jul 15 18:25:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:25:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:25:24 devstack sudo[84171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:25:24 devstack sudo[84171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:25:24 devstack sudo[84171]: pam_unix(sudo:session): session closed for user root Jul 15 18:25:24 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:25:24 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:25:24 devstack sudo[84180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:25:24 devstack sudo[84180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:25:24 devstack sudo[84180]: pam_unix(sudo:session): session closed for user root Jul 15 18:25:24 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:25:24 devstack cinder-volume[76044]: DEBUG cinder.manager [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Notifying Schedulers of capabilities ... {{(pid=76044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:25:24 devstack cinder-volume[76044]: DEBUG oslo_service.periodic_task [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running periodic task VolumeManager._thread_info {{(pid=76044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:25:24 devstack cinder-volume[76044]: DEBUG cinder.volume.manager [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] thread count: 6 {{(pid=76044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:25:24 devstack cinder-volume[76044]: DEBUG cinder.volume.manager [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] thread info: [<_MainThread(MainThread, started 125086909124736)>, , , , , ] {{(pid=76044) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:26:23 devstack cinder-volume[76044]: DEBUG oslo_service.periodic_task [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76044) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:26:23 devstack cinder-volume[76044]: DEBUG cinder.volume.drivers.lvm [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Updating volume stats {{(pid=76044) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 15 18:26:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:26:23 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 15 18:26:23 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:26:23 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Jul 15 18:26:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:26:23 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:26:23 devstack sudo[85546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:26:23 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:26:23 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root Jul 15 18:26:24 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:26:24 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:26:24 devstack sudo[85549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 15 18:26:24 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:26:24 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root Jul 15 18:26:24 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:26:24 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:26:24 devstack sudo[85553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 15 18:26:24 devstack sudo[85553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:26:24 devstack sudo[85553]: pam_unix(sudo:session): session closed for user root Jul 15 18:26:24 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:26:24 devstack cinder-volume[76044]: DEBUG cinder.manager [None req-8c46dc41-b7c0-42e8-b8f4-52fcd5a685d7 None None] Notifying Schedulers of capabilities ... {{(pid=76044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:26:44 devstack cinder-volume[76044]: DEBUG dbcounter [-] [76044] Writing DB stats cinder:SELECT=1 {{(pid=76044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:26:44 devstack cinder-volume[76044]: DEBUG dbcounter [-] [76044] Writing DB stats cinder:UPDATE=1 {{(pid=76044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:27:07 devstack cinder-volume[75856]: INFO oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Caught SIGTERM, stopping children Jul 15 18:27:07 devstack cinder-volume[75856]: DEBUG oslo_concurrency.lockutils [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Acquiring lock "singleton_lock" {{(pid=75856) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:27:07 devstack cinder-volume[75856]: DEBUG oslo_concurrency.lockutils [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Acquired lock "singleton_lock" {{(pid=75856) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:27:07 devstack cinder-volume[75856]: DEBUG oslo_concurrency.lockutils [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Releasing lock "singleton_lock" {{(pid=75856) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:27:07 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Stop services. {{(pid=75856) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 15 18:27:07 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Killing children. {{(pid=75856) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 15 18:27:07 devstack cinder-volume[75856]: INFO oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Waiting on 1 children to exit Jul 15 18:27:08 devstack cinder-volume[76044]: DEBUG oslo_concurrency.lockutils [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Acquiring lock "singleton_lock" {{(pid=76044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:27:08 devstack cinder-volume[76044]: DEBUG oslo_concurrency.lockutils [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Acquired lock "singleton_lock" {{(pid=76044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:27:08 devstack cinder-volume[76044]: DEBUG oslo_concurrency.lockutils [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Releasing lock "singleton_lock" {{(pid=76044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:27:08 devstack cinder-volume[76044]: WARNING amqp [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 15 18:27:08 devstack cinder-volume[76044]: WARNING amqp [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 15 18:27:08 devstack cinder-volume[75856]: INFO oslo_service.backend._eventlet.service [None req-524cbbc0-28e8-4f95-bdea-e802d901054e None None] Child 76044 exited with status 0 Jul 15 18:27:08 devstack cinder-volume[86534]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 15 18:27:08 devstack cinder-volume[86534]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 15 18:27:08 devstack cinder-volume[86534]: we strongly recommend against using it for new projects. Jul 15 18:27:08 devstack cinder-volume[86534]: If you are already using Eventlet, we recommend migrating to a different Jul 15 18:27:08 devstack cinder-volume[86534]: framework. For more detail see Jul 15 18:27:08 devstack cinder-volume[86534]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 15 18:27:08 devstack cinder-volume[86534]: import eventlet # noqa Jul 15 18:27:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:27:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:27:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:27:11 devstack cinder-volume[86534]: INFO dbcounter [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Registered counter for database cinder Jul 15 18:27:11 devstack cinder-volume[86534]: DEBUG oslo_db.sqlalchemy.engines [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86534) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writer thread running {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 15 18:27:12 devstack cinder-volume[86534]: INFO cinder.rpc [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 15 18:27:12 devstack cinder-volume[86534]: INFO cinder.rpc [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_db.sqlalchemy.engines [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86534) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:27:12 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Determined volume DB was empty at startup. Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86534) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 15 18:27:12 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 15 18:27:12 devstack cinder-volume[86534]: WARNING stevedore.named [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 15 18:27:12 devstack cinder-volume[86534]: WARNING castellan.key_manager [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:27:12 devstack cinder-volume[86534]: WARNING cinder.keymgr.conf_key_mgr [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:27:12 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_db.sqlalchemy.engines [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86534) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:27:12 devstack cinder-volume[86534]: INFO oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Starting 1 workers Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Started child 86774 {{(pid=86534) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Full set of CONF: {{(pid=86534) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] ******************************************************************************** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Configuration options gathered from: {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] ================================================================================ {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] allow_availability_zone_fallback = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] allow_compression_on_image_upload = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] allowed_direct_url_schemes = [] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] api_rate_limit = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86774]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] auth_strategy = keystone {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_availability_zone = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_host = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_name = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_stats_polling_interval = 60 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backup_api_class = cinder.backup.api.API {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backup_name_template = backup-%s {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backup_use_same_host = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backup_use_temp_snapshot = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] chap_password = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] chap_username = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cinder_internal_tenant_project_id = 54335a6b570d4c3f8d4d0ef2adc0ec4f {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cinder_internal_tenant_user_id = 2926f17ef6374fb085d3794331af7ba6 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cluster = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] compression_format = gzip {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] compute_api_class = cinder.compute.nova.API {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] config_dir = [] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] config_source = [] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] control_exchange = openstack {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] debug = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] default_availability_zone = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] default_group_type = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] default_volume_type = QuobyteHD {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] disk_geometry = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] driver_client_cert = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] driver_client_cert_key = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] driver_data_namespace = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] driver_ssl_cert_path = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] driver_ssl_cert_verify = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] driver_use_ssl = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] enable_new_services = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] enable_unsupported_driver = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] enabled_backends = ['QuobyteHD'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] enforce_multipath_for_image_xfer = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] filter_function = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance_api_insecure = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance_api_servers = ['http://192.168.122.218/image'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance_api_ssl_compression = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance_ca_certificates_file = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance_catalog_info = image:glance:publicURL {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance_certfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance_keyfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance_num_retries = 3 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance_request_timeout = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] goodness_function = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] graceful_shutdown_timeout = 5 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] group_api_class = cinder.group.api.API {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] host = devstack {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] image_compress_on_upload = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] image_conversion_address_space_limit = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] image_conversion_cpu_limit = 60 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] image_conversion_disable = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] image_upload_use_cinder_backend = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] image_upload_use_internal_tenant = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] image_volume_cache_enabled = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] image_volume_cache_max_count = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] image_volume_cache_max_size_gb = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] init_host_max_objects_retrieval = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] instance_format = [instance: %(uuid)s] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] iscsi_target_flags = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] iscsi_write_cache = on {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] iser_helper = tgtadm {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] iser_ip_address = 192.168.122.218 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] iser_port = 3260 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] log_color = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] log_config_append = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] log_dir = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] log_file = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] log_options = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] log_rotate_interval = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] log_rotate_interval_type = days {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] log_rotation_type = none {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] max_age = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] max_logfile_count = 30 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] max_logfile_size_mb = 200 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] max_over_subscription_ratio = 20.0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] message_reap_interval = 86400 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] message_ttl = 2592000 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] migration_create_volume_timeout_secs = 300 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] monkey_patch = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] monkey_patch_modules = [] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] my_ip = 192.168.122.218 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] no_snapshot_gb_quota = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] num_iser_scan_tries = 3 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] num_shell_tries = 3 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] num_volume_device_scan_tries = 3 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] nvmeof_conn_info_version = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] nvmet_ns_id = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] nvmet_port_id = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] osapi_max_limit = 1000 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] osapi_volume_ext_list = [] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] osapi_volume_listen_port = 8776 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] osapi_volume_use_ssl = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] osapi_volume_workers = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] per_volume_size_limit = -1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] periodic_fuzzy_delay = 60 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] periodic_interval = 60 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] public_endpoint = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] publish_errors = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] quota_backup_gigabytes = 1000 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] quota_backups = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] quota_gigabytes = 1000 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] quota_groups = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] quota_snapshots = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] quota_volumes = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] rate_limit_burst = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] rate_limit_except_level = CRITICAL {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] rate_limit_interval = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] reinit_driver_count = 3 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86774]: INFO cinder.volume.manager [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] replication_device = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86774]: DEBUG cinder.volume.drivers.remotefs [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86774) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] report_discard_supported = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] report_interval = 120 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] reservation_clean_interval = 86400 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] reservation_expire = 86400 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] reserved_image_namespaces = [] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] reserved_percentage = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] rpc_response_timeout = 120 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] run_external_periodic_tasks = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] scst_target_driver = iscsi {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] scst_target_iqn_name = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] service_down_time = 720 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] shell_completion = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] snapshot_name_template = snapshot-%s {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] split_loggers = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] state_path = /opt/stack/data/cinder {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] storage_availability_zone = nova {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] storage_protocol = iSCSI {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] syslog_log_facility = LOG_USER {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] target_helper = lioadm {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] target_ip_address = 192.168.122.218 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] target_port = 3260 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] target_protocol = iscsi {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] target_secondary_ip_addresses = [] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] trace_flags = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] transport_url = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] until_refresh = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] use_chap_auth = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] use_default_quota_class = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] use_journal = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] use_json = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] use_multipath_for_image_xfer = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] use_stderr = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] use_syslog = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] verify_glance_signatures = enabled {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volume_api_class = cinder.volume.api.API {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volume_backend_name = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volume_clear = zero {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volume_clear_ionice = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volume_clear_size = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volume_copy_bps_limit = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volume_dd_blocksize = 1M {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volume_name_template = volume-%s {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volume_service_inithost_offload = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volume_usage_audit_period = month {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] zoning_mode = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_concurrency.disable_process_locking = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.auth_section = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.auth_type = password {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.auth_version = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.cache = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.certfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.include_service_catalog = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.insecure = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.interface = public {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.keyfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_password = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcache_username = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.region_name = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.service_type = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.218/identity {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.backend = dogpile.cache.null {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.backend_argument = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.backend_expiration_time = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86774]: DEBUG cinder.volume.drivers.quobyte [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86774) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 15 18:27:12 devstack cinder-volume[86774]: WARNING cinder.volume.drivers.quobyte [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 15 18:27:12 devstack cinder-volume[86774]: WARNING cinder.volume.drivers.quobyte [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.config_prefix = cache.oslo {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.debug_cache_backend = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86774]: DEBUG oslo_concurrency.processutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Running cmd (subprocess): mount.quobyte {{(pid=86774) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.enable_retry_client = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.enable_socket_keepalive = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.enabled = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.expiration_time = 600 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.hashclient_retry_attempts = 2 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.memcache_dead_retry = 300 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.memcache_pool_maxsize = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.memcache_sasl_enabled = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.password = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.proxies = [] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.redis_db = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.redis_server = localhost:6379 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.retry_attempts = 2 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.retry_delay = 0.0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.socket_keepalive_count = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.socket_keepalive_idle = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.socket_keepalive_interval = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.socket_timeout = 1.0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.tls_allowed_ciphers = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.tls_cafile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.tls_certfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.tls_enabled = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.tls_keyfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cache.username = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] coordination.backend_url = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.asyncio_connection = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.asyncio_slave_connection = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.backend = sqlalchemy {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.connection = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.connection_debug = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.connection_parameters = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.connection_recycle_time = 3600 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.connection_trace = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.db_inc_retry_interval = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.db_max_retries = 20 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.db_max_retry_interval = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.db_retry_interval = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.max_overflow = 50 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.max_pool_size = 5 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.max_retries = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.mysql_wsrep_sync_wait = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.pool_timeout = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.retry_interval = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.slave_connection = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.sqlite_synchronous = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.synchronous_reader = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] database.use_db_reconnect = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler.connection_string = messaging:// {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler.enabled = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler.es_doc_type = notification {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler.es_scroll_size = 10000 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler.es_scroll_time = 2m {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler.filter_error_trace = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler.hmac_keys = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler.sentinel_service_name = mymaster {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler.socket_timeout = 0.1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler.trace_requests = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler.trace_sqlalchemy = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler_jaeger.process_tags = {} {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler_jaeger.service_name_prefix = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] profiler_otlp.service_name_prefix = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_policy.enforce_new_defaults = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_policy.enforce_scope = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_policy.policy_default_rule = default {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_policy.policy_file = policy.yaml {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] privsep_osbrick.group = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] privsep_osbrick.helper_command = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] privsep_osbrick.user = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cinder_sys_admin.group = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cinder_sys_admin.helper_command = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] cinder_sys_admin.user = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] service_user.auth_section = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] service_user.auth_type = password {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] service_user.cafile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] service_user.certfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] service_user.collect_timing = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] service_user.insecure = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] service_user.keyfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] service_user.send_service_user_token = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] service_user.split_loggers = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] service_user.timeout = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance.auth_section = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance.auth_type = password {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance.certfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance.collect_timing = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance.insecure = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance.keyfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance.region_name = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance.split_loggers = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] glance.timeout = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.backend_availability_zone = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.chap_password = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.chap_username = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.disk_geometry = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.driver_client_cert = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.driver_client_cert_key = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.driver_data_namespace = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.driver_use_ssl = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.extra_capabilities = {} {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.filter_function = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.goodness_function = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.iscsi_target_flags = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.iscsi_write_cache = on {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.iser_helper = tgtadm {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.iser_ip_address = 192.168.122.218 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.iser_port = 3260 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nas_host = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nas_login = admin {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nas_mount_options = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nas_password = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nas_private_key = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nas_share_path = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.num_shell_tries = 3 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.quobyte_volume_url = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.replication_device = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.report_discard_supported = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.reserved_percentage = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.target_helper = tgtadm {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.target_ip_address = 192.168.122.218 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.target_port = 3260 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.target_protocol = iscsi {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.trace_flags = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.unique_fqdn_network = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.use_chap_auth = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.volume_backend_name = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.volume_clear = zero {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.volume_clear_ionice = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.volume_clear_size = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_reports.file_event_handler = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_reports.log_dir = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.backend_availability_zone = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.backend_host = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.chap_password = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86774]: DEBUG oslo_concurrency.processutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] CMD "mount.quobyte" returned: 1 in 0.118s {{(pid=86774) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:12 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86774) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:27:12 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86774) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:27:12 devstack cinder-volume[86774]: DEBUG cinder.volume.drivers.quobyte [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=86774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:27:12 devstack cinder-volume[86774]: INFO cinder.volume.drivers.quobyte [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d ... Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.chap_username = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.chiscsi_conf = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.disk_geometry = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.driver_client_cert = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86774]: DEBUG oslo_concurrency.processutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 -c /etc/quobyte/client-cinder.cfg {{(pid=86774) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.driver_data_namespace = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.driver_use_ssl = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.extra_capabilities = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.filter_function = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.goodness_function = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.iser_helper = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.iser_ip_address = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.iser_port = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.iser_target_prefix = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nas_host = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nas_login = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nas_mount_options = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nas_password = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nas_private_key = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nas_share_path = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nas_ssh_port = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.num_shell_tries = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.nvmet_port_id = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.replication_device = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.report_discard_supported = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.reserved_percentage = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.scst_target_driver = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.storage_protocol = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.target_helper = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.target_ip_address = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.target_port = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.target_prefix = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.target_protocol = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.trace_flags = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.use_chap_auth = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.volume_clear = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.volume_clear_size = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] QuobyteHD.volumes_dir = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.ssl = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 -c /etc/quobyte/client-cinder.cfg Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_notifications.driver = [] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_notifications.retry = -1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] key_manager.fixed_key = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.barbican_api_version = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.barbican_endpoint = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.barbican_endpoint_type = public {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.barbican_region_name = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.cafile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.certfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.collect_timing = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.insecure = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.keyfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.number_of_retries = 60 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.retry_delay = 1 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.send_service_user_token = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.split_loggers = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.timeout = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.verify_ssl = True {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican.verify_ssl_path = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican_service_user.auth_section = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican_service_user.auth_type = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican_service_user.cafile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican_service_user.certfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican_service_user.collect_timing = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican_service_user.insecure = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican_service_user.keyfile = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican_service_user.split_loggers = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] barbican_service_user.timeout = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.approle_role_id = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.approle_secret_id = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.auth_method = approle {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.auth_path = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.kv_mountpoint = secret {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.kv_path = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.kv_version = 2 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.namespace = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.root_token_id = **** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.ssl_ca_crt_file = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.timeout = 60.0 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.token_file = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.token_role = None {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.use_ssl = False {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:12 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] ******************************************************************************** {{(pid=86534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 15 18:27:13 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG oslo_concurrency.processutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.427s {{(pid=86774) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:13 devstack cinder-volume[86774]: INFO cinder.volume.drivers.quobyte [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d succeeded Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG cinder.volume.drivers.quobyte [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=86774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.445s {{(pid=86774) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG oslo_concurrency.processutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=86774) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:13 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:27:13 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:27:13 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG oslo_concurrency.processutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.334s {{(pid=86774) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:13 devstack cinder-volume[86774]: INFO cinder.volume.driver [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Driver hasn't implemented _init_vendor_properties() Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG cinder.volume.driver [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6185874938965, 'free_capacity_gb': 1775.6185874938965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86774) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG oslo_db.sqlalchemy.engines [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86774) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG dbcounter [-] [86774] Writer thread running {{(pid=86774) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG cinder.db.api [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Building query based on filter {{(pid=86774) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG cinder.image.image_utils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86774) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 15 18:27:13 devstack cinder-volume[86774]: INFO cinder.keymgr.migration [None req-5a81f3b8-1903-4f36-a45e-df5de1504e71 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86774) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86774) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG cinder.volume.drivers.quobyte [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=86774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG cinder.volume.drivers.quobyte [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=86774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86774) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:27:13 devstack cinder-volume[86774]: DEBUG oslo_concurrency.processutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=86774) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:13 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:27:13 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:27:14 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Jul 15 18:27:14 devstack cinder-volume[86774]: DEBUG oslo_concurrency.processutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.339s {{(pid=86774) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:14 devstack cinder-volume[86774]: DEBUG cinder.manager [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Notifying Schedulers of capabilities ... {{(pid=86774) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:27:14 devstack cinder-volume[86774]: INFO cinder.volume.manager [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Driver initialization completed successfully. Jul 15 18:27:14 devstack cinder-volume[86774]: INFO cinder.manager [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Initiating service 3 cleanup Jul 15 18:27:14 devstack cinder-volume[86774]: INFO cinder.manager [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Service 3 cleanup completed. Jul 15 18:27:14 devstack cinder-volume[86774]: DEBUG cinder.service [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Creating RPC server for service cinder-volume {{(pid=86774) start /opt/stack/cinder/cinder/service.py:231}} Jul 15 18:27:14 devstack cinder-volume[86774]: DEBUG cinder.service [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86774) start /opt/stack/cinder/cinder/service.py:237}} Jul 15 18:27:14 devstack cinder-volume[86774]: INFO cinder.volume.manager [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 15 18:27:14 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86774) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:27:14 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86774) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:27:14 devstack cinder-volume[86774]: DEBUG cinder.volume.drivers.quobyte [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=86774) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:27:14 devstack cinder-volume[86774]: DEBUG cinder.volume.drivers.quobyte [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=86774) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:27:14 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86774) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:27:14 devstack cinder-volume[86774]: DEBUG oslo_concurrency.processutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=86774) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:14 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:27:14 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:27:14 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Jul 15 18:27:14 devstack cinder-volume[86774]: DEBUG oslo_concurrency.processutils [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.367s {{(pid=86774) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:14 devstack cinder-volume[86774]: INFO cinder.volume.manager [None req-f88ff4a5-49a7-42ec-80f8-5a8ade7d74d2 None None] Driver post RPC initialization completed successfully. Jul 15 18:27:17 devstack cinder-volume[86534]: INFO oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Caught SIGTERM, stopping children Jul 15 18:27:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Acquiring lock "singleton_lock" {{(pid=86534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:27:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Acquired lock "singleton_lock" {{(pid=86534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:27:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Releasing lock "singleton_lock" {{(pid=86534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:27:17 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Stop services. {{(pid=86534) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 15 18:27:17 devstack cinder-volume[86534]: DEBUG oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Killing children. {{(pid=86534) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 15 18:27:17 devstack cinder-volume[86534]: INFO oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Waiting on 1 children to exit Jul 15 18:27:18 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Acquiring lock "singleton_lock" {{(pid=86774) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:27:18 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Acquired lock "singleton_lock" {{(pid=86774) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:27:18 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Releasing lock "singleton_lock" {{(pid=86774) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:27:18 devstack cinder-volume[86774]: WARNING amqp [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 15 18:27:18 devstack cinder-volume[86774]: WARNING amqp [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 15 18:27:18 devstack cinder-volume[86534]: INFO oslo_service.backend._eventlet.service [None req-2f5c6754-923a-45ab-838e-7c643f3709b1 None None] Child 86774 exited with status 0 Jul 15 18:27:18 devstack cinder-volume[87128]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 15 18:27:18 devstack cinder-volume[87128]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 15 18:27:18 devstack cinder-volume[87128]: we strongly recommend against using it for new projects. Jul 15 18:27:18 devstack cinder-volume[87128]: If you are already using Eventlet, we recommend migrating to a different Jul 15 18:27:18 devstack cinder-volume[87128]: framework. For more detail see Jul 15 18:27:18 devstack cinder-volume[87128]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 15 18:27:18 devstack cinder-volume[87128]: import eventlet # noqa Jul 15 18:27:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87128) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 15 18:27:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87128) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 15 18:27:21 devstack cinder-volume[87128]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87128) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 15 18:27:21 devstack cinder-volume[87128]: INFO dbcounter [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] Registered counter for database cinder Jul 15 18:27:21 devstack cinder-volume[87128]: DEBUG oslo_db.sqlalchemy.engines [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87128) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writer thread running {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 15 18:27:22 devstack cinder-volume[87128]: INFO cinder.rpc [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 15 18:27:22 devstack cinder-volume[87128]: INFO cinder.rpc [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_db.sqlalchemy.engines [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87128) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:27:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] Determined volume DB was empty at startup. Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG cinder.volume.manager [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87128) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 15 18:27:22 devstack cinder-volume[87128]: WARNING stevedore.named [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 15 18:27:22 devstack cinder-volume[87128]: WARNING castellan.key_manager [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:27:22 devstack cinder-volume[87128]: WARNING cinder.keymgr.conf_key_mgr [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 15 18:27:22 devstack cinder-volume[87128]: INFO cinder.volume.manager [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_db.sqlalchemy.engines [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87128) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:27:22 devstack cinder-volume[87128]: INFO oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] Starting 1 workers Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] Started child 87217 {{(pid=87128) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] Full set of CONF: {{(pid=87128) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] ******************************************************************************** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] Configuration options gathered from: {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] ================================================================================ {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 15 18:27:22 devstack cinder-volume[87217]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] allow_availability_zone_fallback = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] allow_compression_on_image_upload = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] allowed_direct_url_schemes = [] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] api_rate_limit = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] auth_strategy = keystone {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_availability_zone = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_host = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_name = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_stats_polling_interval = 60 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backup_api_class = cinder.backup.api.API {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backup_name_template = backup-%s {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backup_use_same_host = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backup_use_temp_snapshot = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] chap_password = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] chap_username = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cinder_internal_tenant_project_id = 54335a6b570d4c3f8d4d0ef2adc0ec4f {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cinder_internal_tenant_user_id = 2926f17ef6374fb085d3794331af7ba6 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cluster = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] compression_format = gzip {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] compute_api_class = cinder.compute.nova.API {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] config_dir = [] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] config_source = [] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] control_exchange = openstack {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] debug = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] default_availability_zone = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] default_group_type = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] default_volume_type = QuobyteHD {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] disk_geometry = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] driver_client_cert = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] driver_client_cert_key = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] driver_data_namespace = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] driver_ssl_cert_path = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] driver_ssl_cert_verify = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] driver_use_ssl = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] enable_new_services = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] enable_unsupported_driver = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] enabled_backends = ['QuobyteHD'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] enforce_multipath_for_image_xfer = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] filter_function = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance_api_insecure = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance_api_servers = ['http://192.168.122.218/image'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance_api_ssl_compression = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance_ca_certificates_file = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance_catalog_info = image:glance:publicURL {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance_certfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance_keyfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance_num_retries = 3 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance_request_timeout = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] goodness_function = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] graceful_shutdown_timeout = 5 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] group_api_class = cinder.group.api.API {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] host = devstack {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] image_compress_on_upload = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] image_conversion_address_space_limit = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] image_conversion_cpu_limit = 60 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] image_conversion_disable = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] image_upload_use_cinder_backend = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] image_upload_use_internal_tenant = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] image_volume_cache_enabled = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] image_volume_cache_max_count = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] image_volume_cache_max_size_gb = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] init_host_max_objects_retrieval = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] instance_format = [instance: %(uuid)s] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] iscsi_target_flags = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] iscsi_write_cache = on {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] iser_helper = tgtadm {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] iser_ip_address = 192.168.122.218 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] iser_port = 3260 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] log_color = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] log_config_append = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] log_dir = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] log_file = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] log_options = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] log_rotate_interval = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] log_rotate_interval_type = days {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] log_rotation_type = none {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87217) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] max_age = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] max_logfile_count = 30 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] max_logfile_size_mb = 200 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] max_over_subscription_ratio = 20.0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] message_reap_interval = 86400 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] message_ttl = 2592000 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] migration_create_volume_timeout_secs = 300 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] monkey_patch = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] monkey_patch_modules = [] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] my_ip = 192.168.122.218 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] no_snapshot_gb_quota = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] num_iser_scan_tries = 3 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] num_shell_tries = 3 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] num_volume_device_scan_tries = 3 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] nvmeof_conn_info_version = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] nvmet_ns_id = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] nvmet_port_id = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] osapi_max_limit = 1000 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] osapi_volume_ext_list = [] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] osapi_volume_listen_port = 8776 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] osapi_volume_use_ssl = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] osapi_volume_workers = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] per_volume_size_limit = -1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] periodic_fuzzy_delay = 60 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] periodic_interval = 60 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] public_endpoint = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] publish_errors = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] quota_backup_gigabytes = 1000 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] quota_backups = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] quota_gigabytes = 1000 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] quota_groups = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] quota_snapshots = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] quota_volumes = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] rate_limit_burst = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] rate_limit_except_level = CRITICAL {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] rate_limit_interval = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] reinit_driver_count = 3 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] replication_device = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] report_discard_supported = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] report_interval = 120 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] reservation_clean_interval = 86400 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] reservation_expire = 86400 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] reserved_image_namespaces = [] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] reserved_percentage = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] rpc_response_timeout = 120 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] run_external_periodic_tasks = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] scst_target_driver = iscsi {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] scst_target_iqn_name = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] service_down_time = 720 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] shell_completion = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] snapshot_name_template = snapshot-%s {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] split_loggers = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] state_path = /opt/stack/data/cinder {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] storage_availability_zone = nova {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] storage_protocol = iSCSI {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] syslog_log_facility = LOG_USER {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] target_helper = lioadm {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] target_ip_address = 192.168.122.218 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] target_port = 3260 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] target_protocol = iscsi {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] target_secondary_ip_addresses = [] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] trace_flags = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] transport_url = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] until_refresh = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] use_chap_auth = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] use_default_quota_class = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] use_journal = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] use_json = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] use_multipath_for_image_xfer = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] use_stderr = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] use_syslog = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] verify_glance_signatures = enabled {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volume_api_class = cinder.volume.api.API {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volume_backend_name = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volume_clear = zero {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volume_clear_ionice = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volume_clear_size = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volume_copy_bps_limit = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volume_dd_blocksize = 1M {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volume_name_template = volume-%s {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volume_service_inithost_offload = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volume_usage_audit_period = month {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] zoning_mode = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_concurrency.disable_process_locking = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.auth_section = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.auth_type = password {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.auth_version = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.cache = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.certfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.include_service_catalog = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.insecure = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.interface = public {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.keyfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_password = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcache_username = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.region_name = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.service_type = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.218/identity {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.backend = dogpile.cache.null {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.backend_argument = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.backend_expiration_time = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.config_prefix = cache.oslo {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.debug_cache_backend = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.enable_retry_client = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.enable_socket_keepalive = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.enabled = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.expiration_time = 600 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.hashclient_retry_attempts = 2 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.memcache_dead_retry = 300 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.memcache_pool_maxsize = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.memcache_sasl_enabled = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.password = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.proxies = [] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.redis_db = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.redis_server = localhost:6379 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.retry_attempts = 2 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.retry_delay = 0.0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.socket_keepalive_count = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.socket_keepalive_idle = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.socket_keepalive_interval = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.socket_timeout = 1.0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.tls_allowed_ciphers = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.tls_cafile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.tls_certfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.tls_enabled = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.tls_keyfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cache.username = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] coordination.backend_url = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.asyncio_connection = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.asyncio_slave_connection = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.backend = sqlalchemy {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.connection = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.connection_debug = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.connection_parameters = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.connection_recycle_time = 3600 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.connection_trace = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.db_inc_retry_interval = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.db_max_retries = 20 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.db_max_retry_interval = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.db_retry_interval = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.max_overflow = 50 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.max_pool_size = 5 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.max_retries = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87217) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 15 18:27:22 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.quobyte [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.mysql_wsrep_sync_wait = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.pool_timeout = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.retry_interval = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.quobyte [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.slave_connection = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.sqlite_synchronous = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.synchronous_reader = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] database.use_db_reconnect = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Running cmd (subprocess): mount.quobyte {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler.connection_string = messaging:// {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler.enabled = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler.es_doc_type = notification {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler.es_scroll_size = 10000 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler.es_scroll_time = 2m {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler.filter_error_trace = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler.hmac_keys = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler.sentinel_service_name = mymaster {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler.socket_timeout = 0.1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler.trace_requests = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler.trace_sqlalchemy = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler_jaeger.process_tags = {} {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler_jaeger.service_name_prefix = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] profiler_otlp.service_name_prefix = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_policy.enforce_new_defaults = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_policy.enforce_scope = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_policy.policy_default_rule = default {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_policy.policy_file = policy.yaml {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] privsep_osbrick.group = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] privsep_osbrick.helper_command = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] privsep_osbrick.user = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cinder_sys_admin.group = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cinder_sys_admin.helper_command = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] cinder_sys_admin.user = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] service_user.auth_section = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] service_user.auth_type = password {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] service_user.cafile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] service_user.certfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] service_user.collect_timing = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] service_user.insecure = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] service_user.keyfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] service_user.send_service_user_token = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] service_user.split_loggers = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] service_user.timeout = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance.auth_section = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance.auth_type = password {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance.certfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance.collect_timing = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance.insecure = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance.keyfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance.region_name = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance.split_loggers = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] glance.timeout = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.backend_availability_zone = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.chap_password = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.chap_username = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.disk_geometry = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.driver_client_cert = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.driver_client_cert_key = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.driver_data_namespace = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.driver_use_ssl = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.extra_capabilities = {} {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.filter_function = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.goodness_function = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.iscsi_target_flags = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.iscsi_write_cache = on {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.iser_helper = tgtadm {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.iser_ip_address = 192.168.122.218 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.iser_port = 3260 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nas_host = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nas_login = admin {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nas_mount_options = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nas_password = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nas_private_key = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nas_share_path = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.num_shell_tries = 3 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.quobyte_volume_url = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.replication_device = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.report_discard_supported = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.reserved_percentage = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.target_helper = tgtadm {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.target_ip_address = 192.168.122.218 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.target_port = 3260 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.target_protocol = iscsi {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.trace_flags = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.unique_fqdn_network = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.use_chap_auth = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.volume_backend_name = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.volume_clear = zero {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.volume_clear_ionice = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.volume_clear_size = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_reports.file_event_handler = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_reports.log_dir = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.backend_availability_zone = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.backend_host = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.chap_password = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.chap_username = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.chiscsi_conf = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.disk_geometry = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.driver_client_cert = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.driver_data_namespace = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.driver_use_ssl = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.extra_capabilities = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.filter_function = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.goodness_function = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.iser_helper = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.iser_ip_address = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.iser_port = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.iser_target_prefix = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nas_host = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nas_login = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nas_mount_options = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nas_password = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nas_private_key = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nas_share_path = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nas_ssh_port = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.num_shell_tries = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.nvmet_port_id = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack quobyte-client[87226]: Reading configuration file: /etc/quobyte/client.cfg Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.replication_device = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.report_discard_supported = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.reserved_percentage = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.scst_target_driver = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack quobyte-client[87226]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.storage_protocol = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.target_helper = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.target_ip_address = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.target_port = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.target_prefix = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.target_protocol = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.trace_flags = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.use_chap_auth = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.volume_clear = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.volume_clear_size = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] QuobyteHD.volumes_dir = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.ssl = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_notifications.driver = [] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_notifications.retry = -1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] key_manager.fixed_key = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.barbican_api_version = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.barbican_endpoint = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.barbican_endpoint_type = public {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.barbican_region_name = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.cafile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.certfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.collect_timing = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.insecure = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.keyfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.number_of_retries = 60 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.retry_delay = 1 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.send_service_user_token = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.split_loggers = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.timeout = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.verify_ssl = True {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican.verify_ssl_path = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican_service_user.auth_section = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican_service_user.auth_type = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican_service_user.cafile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican_service_user.certfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican_service_user.collect_timing = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican_service_user.insecure = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican_service_user.keyfile = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican_service_user.split_loggers = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] barbican_service_user.timeout = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.approle_role_id = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.approle_secret_id = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.auth_method = approle {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.auth_path = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.kv_mountpoint = secret {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.kv_path = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.kv_version = 2 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.namespace = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.root_token_id = **** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.ssl_ca_crt_file = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.timeout = 60.0 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.token_file = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.token_role = None {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.use_ssl = False {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 15 18:27:22 devstack cinder-volume[87128]: DEBUG oslo_service.backend._eventlet.service [None req-dfc221fe-87b1-427b-ae5b-e978d3d8a144 None None] ******************************************************************************** {{(pid=87128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 15 18:27:22 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:27:22 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:27:22 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.227s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:22 devstack cinder-volume[87217]: INFO cinder.volume.driver [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Driver hasn't implemented _init_vendor_properties() Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG cinder.volume.driver [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5915908813477, 'free_capacity_gb': 1775.5915908813477, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87217) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 15 18:27:22 devstack cinder-volume[87217]: DEBUG oslo_db.sqlalchemy.engines [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87217) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writer thread running {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG cinder.db.api [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Building query based on filter {{(pid=87217) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87217) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:23 devstack cinder-volume[87217]: INFO cinder.keymgr.migration [None req-d554a9df-3f71-4462-b9ca-d93ac1389fa1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 15 18:27:23 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:27:23 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:27:23 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.238s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:27:23 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Driver initialization completed successfully. Jul 15 18:27:23 devstack cinder-volume[87217]: INFO cinder.manager [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Initiating service 3 cleanup Jul 15 18:27:23 devstack cinder-volume[87217]: INFO cinder.manager [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Service 3 cleanup completed. Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG cinder.service [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Creating RPC server for service cinder-volume {{(pid=87217) start /opt/stack/cinder/cinder/service.py:231}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG cinder.service [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87217) start /opt/stack/cinder/cinder/service.py:237}} Jul 15 18:27:23 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:27:23 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:27:23 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:27:23 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Jul 15 18:27:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.230s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:27:23 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9d9ac22c-f01d-4c32-9ed8-507dcd74a877 None None] Driver post RPC initialization completed successfully. Jul 15 18:27:32 devstack cinder-volume[87128]: DEBUG dbcounter [-] [87128] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:27:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:27:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 6 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:27:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:27:33 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:27:33 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=3 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:28:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:28:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:28:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:28:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:28:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:28:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:28:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:28:32 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:28:32 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:28:32 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Jul 15 18:28:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.232s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:28:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:28:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:28:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 6 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:28:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:29:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:29:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:29:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:29:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:29:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:29:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:29:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:29:32 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:29:32 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:29:33 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Jul 15 18:29:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.406s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:29:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:29:33 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:30:07 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:30:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Flow 'volume_create_manager' (dc16c4da-c046-4fc3-aac5-65d299e66986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:30:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7226674f-a6db-46ea-8d23-7b3123d51de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7226674f-a6db-46ea-8d23-7b3123d51de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1781819804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ba484b-3c12-4b0f-94cc-2afcbfaa7514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb265d42d13449049e2fac8401acae05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:30:07Z,use_quota=True,user_id='05d4492ca3b443e095328d10cfdc828b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7fb4cf-7c77-4b81-ba87-068c05ff3920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7fb4cf-7c77-4b81-ba87-068c05ff3920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c19547-91a7-4b6b-825e-a899b060d906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c19547-91a7-4b6b-825e-a899b060d906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2ba484b-3c12-4b0f-94cc-2afcbfaa7514', 'volume_name': 'volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4b718a-85e7-4fc7-8b0a-0393922dfd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4b718a-85e7-4fc7-8b0a-0393922dfd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2d1e77-7a68-4fa1-a34f-cb2289e3d98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:08 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Volume c2ba484b-3c12-4b0f-94cc-2afcbfaa7514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514', 'volume_size': 1} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1781819804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ba484b-3c12-4b0f-94cc-2afcbfaa7514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb265d42d13449049e2fac8401acae05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:30:07Z,use_quota=True,user_id='05d4492ca3b443e095328d10cfdc828b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Creating volume c2ba484b-3c12-4b0f-94cc-2afcbfaa7514 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:30:08 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:30:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:08 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514 1073741824 Jul 15 18:30:08 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:09 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514 1073741824" returned: 0 in 1.888s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:10 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514 Jul 15 18:30:10 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:10 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514" returned: 0 in 0.665s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] <== create_volume: return (2639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:30:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.644s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2d1e77-7a68-4fa1-a34f-cb2289e3d98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae21cbe2-6c58-418a-a844-8c81b98ca0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:10 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Volume volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514 (c2ba484b-3c12-4b0f-94cc-2afcbfaa7514): created successfully Jul 15 18:30:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae21cbe2-6c58-418a-a844-8c81b98ca0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Flow 'volume_create_manager' (dc16c4da-c046-4fc3-aac5-65d299e66986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:30:10 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-184a96c0-bb1c-445e-8953-425bafecd587 tempest-VolumesAdminNegativeTest-168353611 None] Created volume successfully. Jul 15 18:30:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Acquiring lock "cinder-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:30:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Lock "cinder-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:30:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Acquiring lock "cinder-quobyte-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:30:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Lock "cinder-quobyte-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514" acquired by "delete_volume" :: waited 0.066s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:30:12 devstack cinder-volume[87217]: INFO oslo.privsep.daemon [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmputb53ipv/privsep.sock'] Jul 15 18:30:12 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmputb53ipv/privsep.sock Jul 15 18:30:12 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:14 devstack cinder-volume[87217]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 15 18:30:14 devstack cinder-volume[87217]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 15 18:30:14 devstack cinder-volume[87217]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 15 18:30:14 devstack cinder-volume[87217]: WARNING oslo.privsep.daemon [-] privsep log: Jul 15 18:30:14 devstack cinder-volume[87217]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 15 18:30:14 devstack cinder-volume[87217]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 15 18:30:14 devstack cinder-volume[87217]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 15 18:30:14 devstack cinder-volume[87217]: WARNING oslo.privsep.daemon [-] privsep log: Jul 15 18:30:14 devstack cinder-volume[87217]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 15 18:30:15 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:15 devstack cinder-volume[87217]: INFO oslo.privsep.daemon [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Spawned new privsep daemon via rootwrap Jul 15 18:30:15 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Accepted privsep connection to /tmp/tmputb53ipv/privsep.sock {{(pid=87217) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 15 18:30:15 devstack cinder-volume[87217]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 15 18:30:15 devstack cinder-volume[87217]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 15 18:30:15 devstack cinder-volume[87217]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 15 18:30:15 devstack cinder-volume[87217]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88632 Jul 15 18:30:15 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bf0e87-a691-4797-9263-402419b9f3ca]: (2,) {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:30:15 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[9221aba9-9633-46c7-9552-cf7d839af0b9]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:30:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:15 devstack sudo[88635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514 Jul 15 18:30:15 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:16 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514" returned: 0 in 1.251s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:16 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514 Jul 15 18:30:16 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:16 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514" returned: 0 in 0.568s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Lock "cinder-quobyte-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514" released by "delete_volume" :: held 4.952s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:30:17 devstack cinder-volume[87217]: WARNING cinder.quota [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:30:17 devstack cinder-volume[87217]: WARNING cinder.quota [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:30:17 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Created reservations ['9b8d7bc9-4a8f-4f19-9ba9-d83d9186ad6e', '5776eb08-cbf1-4f1f-aca4-4474ddefe4f1', 'cf7e9e4f-1cd5-4d8b-ac03-e0942ec90074', 'b8790d6c-07ed-455b-944d-437dcd9f2267'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:30:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:30:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:30:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:17 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:30:17 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:18 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.559s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:18 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:30:18 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Deleted volume successfully. Jul 15 18:30:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c26d669b-d610-461e-b271-bf31f10117e0 tempest-VolumesAdminNegativeTest-168353611 None] Lock "cinder-c2ba484b-3c12-4b0f-94cc-2afcbfaa7514-delete_volume" released by "delete_volume" :: held 6.315s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=6,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Flow 'volume_create_manager' (6f28edc7-97a9-4bb1-931b-f145419d92ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb439e8-6881-41c7-a9d3-68d472e98258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb439e8-6881-41c7-a9d3-68d472e98258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-200670410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f112f8-f09f-4ad2-a60c-35c2658263d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be448abdcd154ee2bad1c15462bdea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:30:28Z,use_quota=True,user_id='9c7b1c656f99435ea51e9a98ed949485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feefb1cd-7005-4c0d-a0ec-9955d898ddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feefb1cd-7005-4c0d-a0ec-9955d898ddb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c1b383-9c51-4f46-a367-8291e1fdb848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c1b383-9c51-4f46-a367-8291e1fdb848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f112f8-f09f-4ad2-a60c-35c2658263d1', 'volume_name': 'volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a490fdb-6dad-4ede-93d2-075377327a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a490fdb-6dad-4ede-93d2-075377327a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d676fb50-bef3-4869-a595-84ba32f2ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:27 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Volume a2f112f8-f09f-4ad2-a60c-35c2658263d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1', 'volume_size': 1} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-200670410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f112f8-f09f-4ad2-a60c-35c2658263d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be448abdcd154ee2bad1c15462bdea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:30:28Z,use_quota=True,user_id='9c7b1c656f99435ea51e9a98ed949485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Creating volume a2f112f8-f09f-4ad2-a60c-35c2658263d1 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:30:27 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:30:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:27 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1 1073741824 Jul 15 18:30:27 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:28 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1 1073741824" returned: 0 in 0.782s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:28 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1 Jul 15 18:30:28 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:28 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1" returned: 0 in 0.261s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:30:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d676fb50-bef3-4869-a595-84ba32f2ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45bae35-04ea-42c8-bc94-ee881aee291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:28 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Volume volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1 (a2f112f8-f09f-4ad2-a60c-35c2658263d1): created successfully Jul 15 18:30:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45bae35-04ea-42c8-bc94-ee881aee291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Flow 'volume_create_manager' (6f28edc7-97a9-4bb1-931b-f145419d92ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:30:28 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f217c208-44fc-4dba-90d6-c8ddd951c9b8 tempest-ServersNegativeTestJSON-1048622270 None] Created volume successfully. Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Flow 'volume_create_manager' (b67a450e-7e85-4f5a-ba3e-4d714af2e39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73e2eeb-00b6-4e62-97f3-105cb46d2365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73e2eeb-00b6-4e62-97f3-105cb46d2365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1050893629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3447264a-46eb-43cd-85b2-371e1213315c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be448abdcd154ee2bad1c15462bdea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:30:31Z,use_quota=True,user_id='9c7b1c656f99435ea51e9a98ed949485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ea102d-e70f-4f43-b7f1-c32aade306f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ea102d-e70f-4f43-b7f1-c32aade306f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919c151b-302d-4214-922b-5184c2b9f5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919c151b-302d-4214-922b-5184c2b9f5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3447264a-46eb-43cd-85b2-371e1213315c', 'volume_name': 'volume-3447264a-46eb-43cd-85b2-371e1213315c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1dcad35-461e-4973-96c8-4fde98f67de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1dcad35-461e-4973-96c8-4fde98f67de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f807c5ed-4d96-443d-9b32-e45b1a7736d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:31 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Volume 3447264a-46eb-43cd-85b2-371e1213315c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3447264a-46eb-43cd-85b2-371e1213315c', 'volume_size': 1} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1050893629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3447264a-46eb-43cd-85b2-371e1213315c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be448abdcd154ee2bad1c15462bdea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:30:31Z,use_quota=True,user_id='9c7b1c656f99435ea51e9a98ed949485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Creating volume 3447264a-46eb-43cd-85b2-371e1213315c {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:30:31 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:30:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3447264a-46eb-43cd-85b2-371e1213315c 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:31 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3447264a-46eb-43cd-85b2-371e1213315c 1073741824 Jul 15 18:30:31 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:32 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3447264a-46eb-43cd-85b2-371e1213315c 1073741824" returned: 0 in 0.599s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3447264a-46eb-43cd-85b2-371e1213315c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:32 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3447264a-46eb-43cd-85b2-371e1213315c Jul 15 18:30:32 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:32 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3447264a-46eb-43cd-85b2-371e1213315c" returned: 0 in 0.352s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f807c5ed-4d96-443d-9b32-e45b1a7736d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3447264a-46eb-43cd-85b2-371e1213315c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d8838e-f7c6-41b5-b00a-8add90f0a7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:32 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Volume volume-3447264a-46eb-43cd-85b2-371e1213315c (3447264a-46eb-43cd-85b2-371e1213315c): created successfully Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d8838e-f7c6-41b5-b00a-8add90f0a7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Flow 'volume_create_manager' (b67a450e-7e85-4f5a-ba3e-4d714af2e39d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:30:32 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e2c9ea5c-ba10-4a4c-9477-69c6ce9a1d52 tempest-ServersNegativeTestJSON-1048622270 None] Created volume successfully. Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:32 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:30:32 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:33 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.335s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:30:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:30:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 8 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:30:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:30:34 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Acquiring lock "cinder-3447264a-46eb-43cd-85b2-371e1213315c-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:30:34 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Lock "cinder-3447264a-46eb-43cd-85b2-371e1213315c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:30:34 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Acquiring lock "cinder-quobyte-3447264a-46eb-43cd-85b2-371e1213315c" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Lock "cinder-quobyte-3447264a-46eb-43cd-85b2-371e1213315c" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acabd84-0c49-4777-8c9f-89724bc6e4bc]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3447264a-46eb-43cd-85b2-371e1213315c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:35 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3447264a-46eb-43cd-85b2-371e1213315c Jul 15 18:30:35 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:35 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3447264a-46eb-43cd-85b2-371e1213315c" returned: 0 in 0.445s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3447264a-46eb-43cd-85b2-371e1213315c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:35 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3447264a-46eb-43cd-85b2-371e1213315c Jul 15 18:30:35 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:35 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3447264a-46eb-43cd-85b2-371e1213315c" returned: 0 in 0.289s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Lock "cinder-quobyte-3447264a-46eb-43cd-85b2-371e1213315c" released by "delete_volume" :: held 0.786s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Created reservations ['b8afcb05-0ec7-43c2-8a13-568a41acc43b', '4ded4528-471d-48a7-a5be-1427bc59e5dd', 'c9557d32-e760-4b38-8654-8e19d59934d7', '0a87ab4f-5002-4e4c-87ea-7839b0707329'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:35 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:30:35 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Acquiring lock "cinder-a2f112f8-f09f-4ad2-a60c-35c2658263d1-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:30:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Lock "cinder-a2f112f8-f09f-4ad2-a60c-35c2658263d1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:30:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Acquiring lock "cinder-quobyte-a2f112f8-f09f-4ad2-a60c-35c2658263d1" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:30:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Lock "cinder-quobyte-a2f112f8-f09f-4ad2-a60c-35c2658263d1" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:30:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a95547-bdec-457b-9502-6e530bd3e4e6]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:30:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:36 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.330s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:36 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:30:36 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Deleted volume successfully. Jul 15 18:30:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e53e80b3-e92f-42c8-bbbd-32ebba12ec74 tempest-ServersNegativeTestJSON-1048622270 None] Lock "cinder-3447264a-46eb-43cd-85b2-371e1213315c-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:30:36 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1 Jul 15 18:30:36 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:36 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1" returned: 0 in 0.621s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:36 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1 Jul 15 18:30:36 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:37 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2f112f8-f09f-4ad2-a60c-35c2658263d1" returned: 0 in 0.315s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Lock "cinder-quobyte-a2f112f8-f09f-4ad2-a60c-35c2658263d1" released by "delete_volume" :: held 0.999s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:30:37 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Created reservations ['1e5be849-3fed-4113-aacd-498653611c84', '33bb4c43-1833-46b4-8e61-d99cb1824621', '03a88d80-cb87-438a-baf3-62d39b293cc8', '9f1977e4-f221-4412-b026-acf43073ad0c'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:30:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:30:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:30:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:37 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:30:37 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:37 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.292s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:37 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:30:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Deleted volume successfully. Jul 15 18:30:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0db67048-b371-47ee-8c6a-cd6794fcefee tempest-ServersNegativeTestJSON-1048622270 None] Lock "cinder-a2f112f8-f09f-4ad2-a60c-35c2658263d1-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:30:38 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:30:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Flow 'volume_create_manager' (846fbf45-17c7-4f2c-a7ae-0591f87c0360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf27f14-994e-45ec-ba9d-300b03ba5bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf27f14-994e-45ec-ba9d-300b03ba5bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1131270696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d33169-c2de-4aa0-9921-248378090b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6fd8f6b58c4bfe88a6c11bf7176a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:30:39Z,use_quota=True,user_id='9264dd8a1c65424d88b0009a39f9065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf63f75-2b63-4065-a6be-44bc5f1a0732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf63f75-2b63-4065-a6be-44bc5f1a0732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75022dc3-c9f6-4324-bfb2-eb727e677f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75022dc3-c9f6-4324-bfb2-eb727e677f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d33169-c2de-4aa0-9921-248378090b0c', 'volume_name': 'volume-17d33169-c2de-4aa0-9921-248378090b0c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f77bf5b-7528-4c71-ab22-594ba7bf5401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f77bf5b-7528-4c71-ab22-594ba7bf5401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a31976-27bd-43e7-8e51-81da4d9d6007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:39 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Volume 17d33169-c2de-4aa0-9921-248378090b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d33169-c2de-4aa0-9921-248378090b0c', 'volume_size': 1} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1131270696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d33169-c2de-4aa0-9921-248378090b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6fd8f6b58c4bfe88a6c11bf7176a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:30:39Z,use_quota=True,user_id='9264dd8a1c65424d88b0009a39f9065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Creating volume 17d33169-c2de-4aa0-9921-248378090b0c {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:30:39 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:39 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c 1073741824 Jul 15 18:30:39 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:39 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c 1073741824" returned: 0 in 0.743s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:30:39 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c Jul 15 18:30:39 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:30:40 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Jul 15 18:30:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c" returned: 0 in 0.358s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:30:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:30:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:30:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a31976-27bd-43e7-8e51-81da4d9d6007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d33169-c2de-4aa0-9921-248378090b0c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c601488-26f4-4a2d-9372-e45b618736c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:30:40 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Volume volume-17d33169-c2de-4aa0-9921-248378090b0c (17d33169-c2de-4aa0-9921-248378090b0c): created successfully Jul 15 18:30:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c601488-26f4-4a2d-9372-e45b618736c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:30:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Flow 'volume_create_manager' (846fbf45-17c7-4f2c-a7ae-0591f87c0360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:30:40 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-2168b87f-8e53-4005-8949-c33ea6fca2c2 tempest-ServerActionsTestOtherA-2063533124 None] Created volume successfully. Jul 15 18:30:50 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=24,cinder:SELECT=16,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:30:50 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=24,cinder:UPDATE=34,cinder:INSERT=9,cinder:DELETE=5 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:30:59 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:30:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Flow 'volume_create_manager' (7ce4a67e-3ffb-4c71-ade1-ac2087ead6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:30:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c114af7d-c490-4c8a-bf23-d8de96c68a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c114af7d-c490-4c8a-bf23-d8de96c68a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-322636080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3a70d6-6174-45b7-ab32-7dd0bdd34532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46390ac1c0e43d08232fceefdb8cb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:00Z,use_quota=True,user_id='b5da1f29bece48e381b0171c904e6bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc441f8a-d2f0-45ff-8574-26907a2b18c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc441f8a-d2f0-45ff-8574-26907a2b18c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7125d2a-085e-46fd-9752-972a6660f0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7125d2a-085e-46fd-9752-972a6660f0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa3a70d6-6174-45b7-ab32-7dd0bdd34532', 'volume_name': 'volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daa2e4d-fc47-4294-98a5-dabee13568c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daa2e4d-fc47-4294-98a5-dabee13568c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bd464d-eff1-486e-90bc-ba32465d4ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:00 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Volume aa3a70d6-6174-45b7-ab32-7dd0bdd34532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532', 'volume_size': 1} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-322636080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3a70d6-6174-45b7-ab32-7dd0bdd34532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46390ac1c0e43d08232fceefdb8cb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:00Z,use_quota=True,user_id='b5da1f29bece48e381b0171c904e6bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Creating volume aa3a70d6-6174-45b7-ab32-7dd0bdd34532 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:31:00 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:31:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:00 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 1073741824 Jul 15 18:31:00 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:01 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 1073741824" returned: 0 in 0.932s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:01 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 Jul 15 18:31:01 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:01 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:31:01 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Flow 'volume_create_manager' (de974e7e-d536-4bc0-a9aa-127f527510d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36c0fe4-59d4-4578-82ec-e02d46baec93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532" returned: 0 in 0.727s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:31:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36c0fe4-59d4-4578-82ec-e02d46baec93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-914690854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a220c43f-8356-4abe-bfb8-2aa98b8e9a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc1694f0369430f8b5e1ac08f6c409e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:02Z,use_quota=True,user_id='ee67905399284621967f4832c16d6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b31854-607f-4b1c-bff9-df503c7da727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b31854-607f-4b1c-bff9-df503c7da727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90eadfb7-f771-4ab5-a6cc-97a04340ca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90eadfb7-f771-4ab5-a6cc-97a04340ca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a220c43f-8356-4abe-bfb8-2aa98b8e9a05', 'volume_name': 'volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee94d23-d389-41c5-813e-cb991a3bff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee94d23-d389-41c5-813e-cb991a3bff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727ddfbc-34a0-468f-810f-4af5f9c15f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:02 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Volume a220c43f-8356-4abe-bfb8-2aa98b8e9a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05', 'volume_size': 1} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-914690854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a220c43f-8356-4abe-bfb8-2aa98b8e9a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc1694f0369430f8b5e1ac08f6c409e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:02Z,use_quota=True,user_id='ee67905399284621967f4832c16d6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Creating volume a220c43f-8356-4abe-bfb8-2aa98b8e9a05 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:31:02 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bd464d-eff1-486e-90bc-ba32465d4ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e2f03d-6dd4-40a2-be80-2590d20f0397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:02 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05 1073741824 Jul 15 18:31:02 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:02 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Volume volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 (aa3a70d6-6174-45b7-ab32-7dd0bdd34532): created successfully Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e2f03d-6dd4-40a2-be80-2590d20f0397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Flow 'volume_create_manager' (7ce4a67e-3ffb-4c71-ade1-ac2087ead6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:02 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-0e74e537-6213-41eb-b502-0965900fdcae req-e9e5bc94-2a4e-4802-b923-f3bab4671c97 tempest-VolumesSnapshotsTestJSON-670218662 None] Created volume successfully. Jul 15 18:31:02 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05 1073741824" returned: 0 in 0.708s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:02 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05 Jul 15 18:31:02 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:03 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05" returned: 0 in 0.578s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:31:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.371s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727ddfbc-34a0-468f-810f-4af5f9c15f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51eb37e-ae3d-4f22-88b3-dcbd7c75319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:03 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Volume volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05 (a220c43f-8356-4abe-bfb8-2aa98b8e9a05): created successfully Jul 15 18:31:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51eb37e-ae3d-4f22-88b3-dcbd7c75319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Flow 'volume_create_manager' (de974e7e-d536-4bc0-a9aa-127f527510d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] Creating offline snapshot b55be46f-1a40-48f0-9e0b-ca2d51bb3160 of volume aa3a70d6-6174-45b7-ab32-7dd0bdd34532 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:31:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-eda8fd75-01b8-4e1f-92c6-1295348a2db3 tempest-DeleteServersTestJSON-1860447315 None] Created volume successfully. Jul 15 18:31:03 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04b1945-ce51-46f5-bb3d-06c9cab4139c]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:03 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 Jul 15 18:31:03 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:04 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532" returned: 0 in 0.626s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:04 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 1G Jul 15 18:31:04 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:05 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 1G" returned: 0 in 0.902s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:05 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 Jul 15 18:31:05 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:05 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160" returned: 0 in 0.538s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:05 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 is being set with open permissions: ugo+rw Jul 15 18:31:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:05 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 Jul 15 18:31:05 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:06 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160" returned: 0 in 0.700s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:06 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.info Jul 15 18:31:06 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:07 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.info" returned: 0 in 0.882s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:07 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.info is being set with open permissions: ugo+rw Jul 15 18:31:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:07 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.info Jul 15 18:31:07 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:08 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.info" returned: 0 in 0.797s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.733s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:08 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-bbfb3889-3c4b-422a-a6ae-373a170f1373 req-18978eae-05e4-4202-b4fd-dc4e15caddca tempest-VolumesSnapshotsTestJSON-670218662 None] Create snapshot completed successfully Jul 15 18:31:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Acquiring lock "cinder-b55be46f-1a40-48f0-9e0b-ca2d51bb3160-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "cinder-b55be46f-1a40-48f0-9e0b-ca2d51bb3160-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Acquiring lock "cinder-quobyte-aa3a70d6-6174-45b7-ab32-7dd0bdd34532" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "cinder-quobyte-aa3a70d6-6174-45b7-ab32-7dd0bdd34532" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Acquiring lock "cinder-quobyte-b55be46f-1a40-48f0-9e0b-ca2d51bb3160" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "cinder-quobyte-b55be46f-1a40-48f0-9e0b-ca2d51bb3160" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Deleting offline snapshot b55be46f-1a40-48f0-9e0b-ca2d51bb3160 of volume aa3a70d6-6174-45b7-ab32-7dd0bdd34532 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:31:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] snapshot_file for this snap is: volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:31:09 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3026df-6cd6-42be-ab00-bc49b272028c]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:10 devstack cinder-volume[87217]: WARNING py.warnings [req-c0dcec92-0c86-485f-a085-0124e2cf6840 req-557e2e1a-8c66-4084-8a01-2c6734a697d2 tempest-DeleteServersTestJSON-1860447315 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 15 18:31:10 devstack cinder-volume[87217]: .first() Jul 15 18:31:10 devstack cinder-volume[87217]: Jul 15 18:31:10 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 Jul 15 18:31:10 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-c0dcec92-0c86-485f-a085-0124e2cf6840 req-557e2e1a-8c66-4084-8a01-2c6734a697d2 tempest-DeleteServersTestJSON-1860447315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-c0dcec92-0c86-485f-a085-0124e2cf6840 req-557e2e1a-8c66-4084-8a01-2c6734a697d2 tempest-DeleteServersTestJSON-1860447315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:10 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1677afa-9076-4671-83ab-c00080620257]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-c0dcec92-0c86-485f-a085-0124e2cf6840 req-557e2e1a-8c66-4084-8a01-2c6734a697d2 tempest-DeleteServersTestJSON-1860447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:10 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160" returned: 0 in 0.496s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:31:10 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05 Jul 15 18:31:10 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:10 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e43d5b0-5825-456b-bee5-4236fe0f9997]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:10 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 Jul 15 18:31:10 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:10 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-c0dcec92-0c86-485f-a085-0124e2cf6840 req-557e2e1a-8c66-4084-8a01-2c6734a697d2 tempest-DeleteServersTestJSON-1860447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05" returned: 0 in 0.650s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-c0dcec92-0c86-485f-a085-0124e2cf6840 req-557e2e1a-8c66-4084-8a01-2c6734a697d2 tempest-DeleteServersTestJSON-1860447315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.696s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-c0dcec92-0c86-485f-a085-0124e2cf6840 req-557e2e1a-8c66-4084-8a01-2c6734a697d2 tempest-DeleteServersTestJSON-1860447315 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f55f0ca-5a62-46d7-95fd-4409b64cd18b', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:31:11 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-c0dcec92-0c86-485f-a085-0124e2cf6840 req-557e2e1a-8c66-4084-8a01-2c6734a697d2 tempest-DeleteServersTestJSON-1860447315 None] attachment_update completed successfully. Jul 15 18:31:11 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532" returned: 0 in 0.797s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:11 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 Jul 15 18:31:11 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:11 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160" returned: 0 in 0.642s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:11 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160 Jul 15 18:31:11 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:12 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532.b55be46f-1a40-48f0-9e0b-ca2d51bb3160" returned: 0 in 0.426s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "cinder-quobyte-b55be46f-1a40-48f0-9e0b-ca2d51bb3160" released by "_delete_snapshot" :: held 2.578s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "cinder-quobyte-aa3a70d6-6174-45b7-ab32-7dd0bdd34532" released by "delete_snapshot" :: held 2.642s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:12 devstack cinder-volume[87217]: WARNING cinder.quota [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:31:12 devstack cinder-volume[87217]: DEBUG cinder.quota [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Created reservations ['bec51f72-d77f-4499-b061-f2732cdd0625', '50b857c8-fe70-49b2-b10a-ddb2bf9c526f', 'a635cfa6-9d03-4504-8b5e-a66de1309d8a', '2b03fec6-32c7-4c6b-b707-fb657cc0e295'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:31:12 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Delete snapshot completed successfully. Jul 15 18:31:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-fca03b81-6bd8-435b-9938-62ce51638c44 req-665229dc-d391-4a94-abc5-3321512ce0d6 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "cinder-b55be46f-1a40-48f0-9e0b-ca2d51bb3160-delete_snapshot" released by "delete_snapshot" :: held 2.995s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Acquiring lock "cinder-aa3a70d6-6174-45b7-ab32-7dd0bdd34532-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "cinder-aa3a70d6-6174-45b7-ab32-7dd0bdd34532-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Acquiring lock "cinder-quobyte-aa3a70d6-6174-45b7-ab32-7dd0bdd34532" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "cinder-quobyte-aa3a70d6-6174-45b7-ab32-7dd0bdd34532" acquired by "delete_volume" :: waited 0.040s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:13 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d19859c-8fd2-474e-8bb0-05c303947688]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:13 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 Jul 15 18:31:13 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:13 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532" returned: 0 in 0.422s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:13 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532 Jul 15 18:31:13 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:14 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa3a70d6-6174-45b7-ab32-7dd0bdd34532" returned: 0 in 0.369s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "cinder-quobyte-aa3a70d6-6174-45b7-ab32-7dd0bdd34532" released by "delete_volume" :: held 0.899s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:14 devstack cinder-volume[87217]: DEBUG cinder.quota [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Created reservations ['86ec041e-cc25-4b94-bed1-e6ea6a373d26', 'e21543aa-792e-4343-8a9a-2290383d11b8', '7ef9f446-fe9a-452c-b498-5bb4bf105f4b', '7248ef4f-819c-42e6-ba6c-23edef4105f2'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:31:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:14 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:31:14 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:15 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.553s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:15 devstack cinder-volume[87217]: DEBUG cinder.manager [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:31:15 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Deleted volume successfully. Jul 15 18:31:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-442104b7-0418-4dce-aee1-60bdd7ccd5e4 req-79b98045-bba5-45f0-a457-291b110c4f97 tempest-VolumesSnapshotsTestJSON-670218662 None] Lock "cinder-aa3a70d6-6174-45b7-ab32-7dd0bdd34532-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:15 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-bdbee1b0-dac2-4ca8-bd8d-5b7b5379269e req-ac68f22a-f9de-4434-8a3d-ab3863da83ff tempest-DeleteServersTestJSON-1860447315 None] Terminate volume connection completed successfully. Jul 15 18:31:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-bdbee1b0-dac2-4ca8-bd8d-5b7b5379269e req-ac68f22a-f9de-4434-8a3d-ab3863da83ff tempest-DeleteServersTestJSON-1860447315 None] Deleting attachment 1f55f0ca-5a62-46d7-95fd-4409b64cd18b. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:31:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Acquiring lock "cinder-a220c43f-8356-4abe-bfb8-2aa98b8e9a05-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Lock "cinder-a220c43f-8356-4abe-bfb8-2aa98b8e9a05-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Acquiring lock "cinder-quobyte-a220c43f-8356-4abe-bfb8-2aa98b8e9a05" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Lock "cinder-quobyte-a220c43f-8356-4abe-bfb8-2aa98b8e9a05" acquired by "delete_volume" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:17 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d48190-e7da-44a5-89c3-689b8e4615d4]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:17 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05 Jul 15 18:31:17 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:17 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05" returned: 0 in 0.403s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:17 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05 Jul 15 18:31:17 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:18 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a220c43f-8356-4abe-bfb8-2aa98b8e9a05" returned: 0 in 0.425s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Lock "cinder-quobyte-a220c43f-8356-4abe-bfb8-2aa98b8e9a05" released by "delete_volume" :: held 0.887s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:18 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Created reservations ['99be10d9-5e00-4733-9755-5431f4103d5f', 'ce30b18c-b6d1-4a30-b000-539e0117e4e9', 'b54bfd78-5d28-46df-989b-3e583ac70064', 'c9164ce4-e7b3-469b-b89c-bd4b19f9198d'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:31:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:18 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:31:18 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:18 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.354s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:18 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:31:18 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Deleted volume successfully. Jul 15 18:31:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6420eb43-5cb4-4dde-a386-e71568b23f69 tempest-DeleteServersTestJSON-1860447315 None] Lock "cinder-a220c43f-8356-4abe-bfb8-2aa98b8e9a05-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Flow 'volume_create_manager' (dc859bfc-5844-4499-8ba0-1d64b8dc6f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01244efb-cb34-4bb6-bd33-bbb34a7c9c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01244efb-cb34-4bb6-bd33-bbb34a7c9c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2084634913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d120b488-a6ba-4034-9f35-3afbd8fe41ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99afbd93075245ea8e01f0cbef90be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:28Z,use_quota=True,user_id='d798ba8c2358430cb2b855f29d2cca6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a29b73a-8239-4b8a-b23f-b9fc58f31805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a29b73a-8239-4b8a-b23f-b9fc58f31805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4dc4ab-02a6-474f-8282-34dd26121027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4dc4ab-02a6-474f-8282-34dd26121027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd120b488-a6ba-4034-9f35-3afbd8fe41ad', 'volume_name': 'volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3551ed58-100b-4763-8186-896b5f4b007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3551ed58-100b-4763-8186-896b5f4b007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8caed80-2016-4ba8-ae28-99429d3ba2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:28 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Volume d120b488-a6ba-4034-9f35-3afbd8fe41ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad', 'volume_size': 1} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2084634913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d120b488-a6ba-4034-9f35-3afbd8fe41ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99afbd93075245ea8e01f0cbef90be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:28Z,use_quota=True,user_id='d798ba8c2358430cb2b855f29d2cca6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Creating volume d120b488-a6ba-4034-9f35-3afbd8fe41ad {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:31:28 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:28 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad 1073741824 Jul 15 18:31:28 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:28 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad 1073741824" returned: 0 in 0.519s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:29 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad Jul 15 18:31:29 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:29 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad" returned: 0 in 0.353s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:31:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8caed80-2016-4ba8-ae28-99429d3ba2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f41921e-a94e-46a1-ab18-5cfb08014d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:29 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Volume volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad (d120b488-a6ba-4034-9f35-3afbd8fe41ad): created successfully Jul 15 18:31:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f41921e-a94e-46a1-ab18-5cfb08014d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Flow 'volume_create_manager' (dc859bfc-5844-4499-8ba0-1d64b8dc6f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:29 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-08675209-e677-46d0-a3d7-794ccb3a7b81 tempest-TaggedAttachmentsTest-791709439 None] Created volume successfully. Jul 15 18:31:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-6d53f357-0bbc-4e46-a974-edaf215a1de2 req-a740819f-26db-49e4-b637-17eb627038e1 tempest-ServerActionsTestOtherA-2063533124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-6d53f357-0bbc-4e46-a974-edaf215a1de2 req-a740819f-26db-49e4-b637-17eb627038e1 tempest-ServerActionsTestOtherA-2063533124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:29 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4f7eed-88e2-4172-9dd0-853fd2d171c1]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-6d53f357-0bbc-4e46-a974-edaf215a1de2 req-a740819f-26db-49e4-b637-17eb627038e1 tempest-ServerActionsTestOtherA-2063533124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:29 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-049915f0-7754-425d-8449-428175820c76 tempest-GroupsTest-1478013934 None] Group tempest-Group1-298761351: creating Jul 15 18:31:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-049915f0-7754-425d-8449-428175820c76 tempest-GroupsTest-1478013934 None] Group tempest-Group1-298761351: created successfully Jul 15 18:31:30 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c Jul 15 18:31:30 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-049915f0-7754-425d-8449-428175820c76 tempest-GroupsTest-1478013934 None] Create group completed successfully. Jul 15 18:31:30 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-6d53f357-0bbc-4e46-a974-edaf215a1de2 req-a740819f-26db-49e4-b637-17eb627038e1 tempest-ServerActionsTestOtherA-2063533124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c" returned: 0 in 0.456s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-6d53f357-0bbc-4e46-a974-edaf215a1de2 req-a740819f-26db-49e4-b637-17eb627038e1 tempest-ServerActionsTestOtherA-2063533124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.479s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-6d53f357-0bbc-4e46-a974-edaf215a1de2 req-a740819f-26db-49e4-b637-17eb627038e1 tempest-ServerActionsTestOtherA-2063533124 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-17d33169-c2de-4aa0-9921-248378090b0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '104bda37-a9e4-4bf7-8055-36bea8da3776', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:31:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-6d53f357-0bbc-4e46-a974-edaf215a1de2 req-a740819f-26db-49e4-b637-17eb627038e1 tempest-ServerActionsTestOtherA-2063533124 None] attachment_update completed successfully. Jul 15 18:31:31 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9ff3fc87-023a-45e9-987c-468d682ecf4b tempest-GroupsTest-1478013934 None] Group tempest-Group2-995550259: creating Jul 15 18:31:31 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9ff3fc87-023a-45e9-987c-468d682ecf4b tempest-GroupsTest-1478013934 None] Group tempest-Group2-995550259: created successfully Jul 15 18:31:31 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9ff3fc87-023a-45e9-987c-468d682ecf4b tempest-GroupsTest-1478013934 None] Create group completed successfully. Jul 15 18:31:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:31:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:32 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:31:32 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:33 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.390s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 8 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Flow 'volume_create_manager' (850a7f03-5590-4611-88c1-e778eeb680c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111d9092-1380-45de-82d8-12e9827fac46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111d9092-1380-45de-82d8-12e9827fac46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1739130463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42a231e4-6cd2-416e-9d72-6c918a7b6083,host='devstack@QuobyteHD#QuobyteHD',id=f036af20-0108-4a2d-b718-49f7babae36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbda18463634ab9a24425416f404b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:33Z,use_quota=True,user_id='238479d2c8a74e2db673b9f03ebe04e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c7302b0-ee86-40fc-8389-93865b09ed93),volume_type_id=7c7302b0-ee86-40fc-8389-93865b09ed93)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b132945-123a-453a-8e0a-8fa8cf73fb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b132945-123a-453a-8e0a-8fa8cf73fb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a03c6f-6b5a-4b2d-b975-e1f20a032de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a03c6f-6b5a-4b2d-b975-e1f20a032de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f036af20-0108-4a2d-b718-49f7babae36c', 'volume_name': 'volume-f036af20-0108-4a2d-b718-49f7babae36c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009828a7-13a0-47d5-b899-9228ad60e477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009828a7-13a0-47d5-b899-9228ad60e477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e174236b-86c6-40af-801c-1513472555d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:33 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Volume f036af20-0108-4a2d-b718-49f7babae36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f036af20-0108-4a2d-b718-49f7babae36c', 'volume_size': 1} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=42a231e4-6cd2-416e-9d72-6c918a7b6083,created_at=2026-07-15T16:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1739130463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42a231e4-6cd2-416e-9d72-6c918a7b6083,host='devstack@QuobyteHD#QuobyteHD',id=f036af20-0108-4a2d-b718-49f7babae36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbda18463634ab9a24425416f404b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:33Z,use_quota=True,user_id='238479d2c8a74e2db673b9f03ebe04e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c7302b0-ee86-40fc-8389-93865b09ed93),volume_type_id=7c7302b0-ee86-40fc-8389-93865b09ed93)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Creating volume f036af20-0108-4a2d-b718-49f7babae36c {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:31:33 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f036af20-0108-4a2d-b718-49f7babae36c 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:33 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f036af20-0108-4a2d-b718-49f7babae36c 1073741824 Jul 15 18:31:33 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:33 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f036af20-0108-4a2d-b718-49f7babae36c 1073741824" returned: 0 in 0.613s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f036af20-0108-4a2d-b718-49f7babae36c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:34 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f036af20-0108-4a2d-b718-49f7babae36c Jul 15 18:31:34 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:34 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f036af20-0108-4a2d-b718-49f7babae36c" returned: 0 in 0.315s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:31:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e174236b-86c6-40af-801c-1513472555d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f036af20-0108-4a2d-b718-49f7babae36c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fc65b8-1b5f-4de8-a88d-53df6a9d989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:34 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Volume volume-f036af20-0108-4a2d-b718-49f7babae36c (f036af20-0108-4a2d-b718-49f7babae36c): created successfully Jul 15 18:31:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fc65b8-1b5f-4de8-a88d-53df6a9d989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Flow 'volume_create_manager' (850a7f03-5590-4611-88c1-e778eeb680c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:34 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-36deff9f-d136-4581-8df3-caf3817b3ba7 tempest-GroupsTest-1478013934 None] Created volume successfully. Jul 15 18:31:35 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-192468cc-67dd-4c71-b734-2f39fb558a09 req-facc28ea-f526-4106-89b5-555fdf512ebb tempest-ServerActionsTestOtherA-2063533124 None] Terminate volume connection completed successfully. Jul 15 18:31:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-192468cc-67dd-4c71-b734-2f39fb558a09 req-facc28ea-f526-4106-89b5-555fdf512ebb tempest-ServerActionsTestOtherA-2063533124 None] Deleting attachment 104bda37-a9e4-4bf7-8055-36bea8da3776. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:31:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-192468cc-67dd-4c71-b734-2f39fb558a09 req-549fc361-5405-45fa-82b0-743900aec3e8 tempest-ServerActionsTestOtherA-2063533124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-192468cc-67dd-4c71-b734-2f39fb558a09 req-549fc361-5405-45fa-82b0-743900aec3e8 tempest-ServerActionsTestOtherA-2063533124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7a4afc-8b01-4211-8feb-b575327b9a79]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-192468cc-67dd-4c71-b734-2f39fb558a09 req-549fc361-5405-45fa-82b0-743900aec3e8 tempest-ServerActionsTestOtherA-2063533124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:36 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c Jul 15 18:31:36 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:36 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-192468cc-67dd-4c71-b734-2f39fb558a09 req-549fc361-5405-45fa-82b0-743900aec3e8 tempest-ServerActionsTestOtherA-2063533124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c" returned: 0 in 0.463s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-192468cc-67dd-4c71-b734-2f39fb558a09 req-549fc361-5405-45fa-82b0-743900aec3e8 tempest-ServerActionsTestOtherA-2063533124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.489s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-192468cc-67dd-4c71-b734-2f39fb558a09 req-549fc361-5405-45fa-82b0-743900aec3e8 tempest-ServerActionsTestOtherA-2063533124 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-17d33169-c2de-4aa0-9921-248378090b0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2da7dd7-54c7-4637-b96e-a293591ed68e', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:31:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Acquiring lock "cinder-quobyte-f036af20-0108-4a2d-b718-49f7babae36c" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:36 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-192468cc-67dd-4c71-b734-2f39fb558a09 req-549fc361-5405-45fa-82b0-743900aec3e8 tempest-ServerActionsTestOtherA-2063533124 None] attachment_update completed successfully. Jul 15 18:31:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Lock "cinder-quobyte-f036af20-0108-4a2d-b718-49f7babae36c" acquired by "delete_volume" :: waited 0.051s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:37 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe53b2dd-68a9-4629-8aa6-043e601143d8]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f036af20-0108-4a2d-b718-49f7babae36c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:37 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f036af20-0108-4a2d-b718-49f7babae36c Jul 15 18:31:37 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:37 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f036af20-0108-4a2d-b718-49f7babae36c" returned: 0 in 0.548s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f036af20-0108-4a2d-b718-49f7babae36c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:37 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f036af20-0108-4a2d-b718-49f7babae36c Jul 15 18:31:37 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:38 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f036af20-0108-4a2d-b718-49f7babae36c" returned: 0 in 0.465s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Lock "cinder-quobyte-f036af20-0108-4a2d-b718-49f7babae36c" released by "delete_volume" :: held 1.094s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:38 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Created reservations ['8842cab8-8e32-4ea7-803f-c89dab259ca8'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:31:38 devstack cinder-volume[87217]: WARNING cinder.quota [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1060662341 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1060662341, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:31:38 devstack cinder-volume[87217]: WARNING cinder.quota [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1060662341 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1060662341, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:31:38 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Created reservations ['a4967681-d1c0-4acc-b440-92d8d85d5c25', '88e8b99f-28b0-4e26-9e94-756250c2df37', '00018586-fecc-41ac-a09a-baad3218ad79', '373310e7-74a5-44ac-bb19-6b62729cc69c'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:31:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:38 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:31:38 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:38 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.333s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:38 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:31:38 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f0affd70-12ef-4086-b428-96e4b976bcb3 tempest-GroupsTest-1478013934 None] Delete group completed successfully. Jul 15 18:31:39 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-384d331e-a690-43a1-b046-1886bcb84c6f tempest-GroupsTest-1478013934 None] Created reservations ['79d15db2-4236-4977-95de-67bedf3e7f1a'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:31:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-384d331e-a690-43a1-b046-1886bcb84c6f tempest-GroupsTest-1478013934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-384d331e-a690-43a1-b046-1886bcb84c6f tempest-GroupsTest-1478013934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-384d331e-a690-43a1-b046-1886bcb84c6f tempest-GroupsTest-1478013934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-384d331e-a690-43a1-b046-1886bcb84c6f tempest-GroupsTest-1478013934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-384d331e-a690-43a1-b046-1886bcb84c6f tempest-GroupsTest-1478013934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-384d331e-a690-43a1-b046-1886bcb84c6f tempest-GroupsTest-1478013934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:39 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:31:39 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:40 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-384d331e-a690-43a1-b046-1886bcb84c6f tempest-GroupsTest-1478013934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.343s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:40 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-384d331e-a690-43a1-b046-1886bcb84c6f tempest-GroupsTest-1478013934 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:31:40 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-384d331e-a690-43a1-b046-1886bcb84c6f tempest-GroupsTest-1478013934 None] Delete group completed successfully. Jul 15 18:31:42 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-dabeac28-3132-47d2-831f-12c71f694436 tempest-GroupsTest-1478013934 None] Group tempest-GroupsTest-Group-816485662: creating Jul 15 18:31:42 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-dabeac28-3132-47d2-831f-12c71f694436 tempest-GroupsTest-1478013934 None] Group tempest-GroupsTest-Group-816485662: created successfully Jul 15 18:31:42 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-dabeac28-3132-47d2-831f-12c71f694436 tempest-GroupsTest-1478013934 None] Create group completed successfully. Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Flow 'volume_create_manager' (c0875a5a-8d29-42da-8993-3f322c98c7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6947245-f6ea-423b-9778-ec8976e40f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6947245-f6ea-423b-9778-ec8976e40f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-600606735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eab6928f-fd1c-4876-857a-4711aaedeb83,host='devstack@QuobyteHD#QuobyteHD',id=5001607e-30f0-44c6-b67a-4a4919ea2715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbda18463634ab9a24425416f404b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:44Z,use_quota=True,user_id='238479d2c8a74e2db673b9f03ebe04e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23714675-c245-4444-842c-637f4e028e85),volume_type_id=23714675-c245-4444-842c-637f4e028e85)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5719777c-d9f2-4126-82d2-8750b1d5edb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5719777c-d9f2-4126-82d2-8750b1d5edb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7acafe-799b-441c-9b14-72a7ffd705f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7acafe-799b-441c-9b14-72a7ffd705f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5001607e-30f0-44c6-b67a-4a4919ea2715', 'volume_name': 'volume-5001607e-30f0-44c6-b67a-4a4919ea2715', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815b7e3a-e68f-4eb2-a8cb-64e1c7aba00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815b7e3a-e68f-4eb2-a8cb-64e1c7aba00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e638f2-5f5f-48c5-b12b-e54ee9a543ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:44 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Volume 5001607e-30f0-44c6-b67a-4a4919ea2715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5001607e-30f0-44c6-b67a-4a4919ea2715', 'volume_size': 1} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eab6928f-fd1c-4876-857a-4711aaedeb83,created_at=2026-07-15T16:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-600606735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eab6928f-fd1c-4876-857a-4711aaedeb83,host='devstack@QuobyteHD#QuobyteHD',id=5001607e-30f0-44c6-b67a-4a4919ea2715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbda18463634ab9a24425416f404b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:44Z,use_quota=True,user_id='238479d2c8a74e2db673b9f03ebe04e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23714675-c245-4444-842c-637f4e028e85),volume_type_id=23714675-c245-4444-842c-637f4e028e85)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Creating volume 5001607e-30f0-44c6-b67a-4a4919ea2715 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:31:44 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:31:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5001607e-30f0-44c6-b67a-4a4919ea2715 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:44 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5001607e-30f0-44c6-b67a-4a4919ea2715 1073741824 Jul 15 18:31:44 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:45 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5001607e-30f0-44c6-b67a-4a4919ea2715 1073741824" returned: 0 in 0.665s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5001607e-30f0-44c6-b67a-4a4919ea2715 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:45 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5001607e-30f0-44c6-b67a-4a4919ea2715 Jul 15 18:31:45 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5001607e-30f0-44c6-b67a-4a4919ea2715" returned: 0 in 0.325s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:45 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:31:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e638f2-5f5f-48c5-b12b-e54ee9a543ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5001607e-30f0-44c6-b67a-4a4919ea2715', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e81b2d-6923-428c-b6e6-13d17f2f03ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:45 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Volume volume-5001607e-30f0-44c6-b67a-4a4919ea2715 (5001607e-30f0-44c6-b67a-4a4919ea2715): created successfully Jul 15 18:31:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e81b2d-6923-428c-b6e6-13d17f2f03ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Flow 'volume_create_manager' (c0875a5a-8d29-42da-8993-3f322c98c7bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:45 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ee90a709-dfd5-4141-8829-9c248d7a2848 tempest-GroupsTest-1478013934 None] Created volume successfully. Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Flow 'volume_create_manager' (5b4b7a42-f1ca-4a9b-8d6a-7152fbb0bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf24e9f-f572-4633-8a8e-33ed12c0ca13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf24e9f-f572-4633-8a8e-33ed12c0ca13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727411559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eab6928f-fd1c-4876-857a-4711aaedeb83,host='devstack@QuobyteHD#QuobyteHD',id=38713b06-82df-472a-b031-a983c173bd5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbda18463634ab9a24425416f404b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:48Z,use_quota=True,user_id='238479d2c8a74e2db673b9f03ebe04e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23714675-c245-4444-842c-637f4e028e85),volume_type_id=23714675-c245-4444-842c-637f4e028e85)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f1141b-e9cf-4485-8a5b-9b789452f37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f1141b-e9cf-4485-8a5b-9b789452f37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b0824c-ddea-4078-8320-d467368ed550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b0824c-ddea-4078-8320-d467368ed550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38713b06-82df-472a-b031-a983c173bd5e', 'volume_name': 'volume-38713b06-82df-472a-b031-a983c173bd5e', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4b90c0-fa85-40ed-9b77-2374d2701516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4b90c0-fa85-40ed-9b77-2374d2701516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4d274f-c271-4c05-9dce-34ae8f8c4f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:48 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Volume 38713b06-82df-472a-b031-a983c173bd5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38713b06-82df-472a-b031-a983c173bd5e', 'volume_size': 1} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eab6928f-fd1c-4876-857a-4711aaedeb83,created_at=2026-07-15T16:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727411559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eab6928f-fd1c-4876-857a-4711aaedeb83,host='devstack@QuobyteHD#QuobyteHD',id=38713b06-82df-472a-b031-a983c173bd5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbda18463634ab9a24425416f404b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:31:48Z,use_quota=True,user_id='238479d2c8a74e2db673b9f03ebe04e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23714675-c245-4444-842c-637f4e028e85),volume_type_id=23714675-c245-4444-842c-637f4e028e85)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Creating volume 38713b06-82df-472a-b031-a983c173bd5e {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:31:48 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:31:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-38713b06-82df-472a-b031-a983c173bd5e 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:48 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-38713b06-82df-472a-b031-a983c173bd5e 1073741824 Jul 15 18:31:48 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:49 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-38713b06-82df-472a-b031-a983c173bd5e 1073741824" returned: 0 in 1.236s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-38713b06-82df-472a-b031-a983c173bd5e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:50 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-38713b06-82df-472a-b031-a983c173bd5e Jul 15 18:31:50 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:50 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-38713b06-82df-472a-b031-a983c173bd5e" returned: 0 in 0.605s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:31:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:31:50 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=53,cinder:SELECT=57,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:31:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4d274f-c271-4c05-9dce-34ae8f8c4f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38713b06-82df-472a-b031-a983c173bd5e', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c941a4ee-711b-4cf3-a74d-5341d6cb6354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:31:50 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=79,cinder:UPDATE=70,cinder:DELETE=4,cinder:INSERT=11 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:31:50 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Volume volume-38713b06-82df-472a-b031-a983c173bd5e (38713b06-82df-472a-b031-a983c173bd5e): created successfully Jul 15 18:31:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c941a4ee-711b-4cf3-a74d-5341d6cb6354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:31:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Flow 'volume_create_manager' (5b4b7a42-f1ca-4a9b-8d6a-7152fbb0bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:31:50 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d5c12813-8e50-4738-ab74-c1e981972cb9 tempest-GroupsTest-1478013934 None] Created volume successfully. Jul 15 18:31:52 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8281b3d5-8956-4401-a686-75b0a512ef7e tempest-GroupsTest-1478013934 None] Update group completed successfully. Jul 15 18:31:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c15c6b38-56b6-4041-b922-7a39522c18ac tempest-GroupsTest-1478013934 None] Update group completed successfully. Jul 15 18:31:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Acquiring lock "cinder-quobyte-38713b06-82df-472a-b031-a983c173bd5e" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Lock "cinder-quobyte-38713b06-82df-472a-b031-a983c173bd5e" acquired by "delete_volume" :: waited 0.036s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:56 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[78297f0f-68ad-4692-b43e-e0f839031110]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-38713b06-82df-472a-b031-a983c173bd5e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:57 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-38713b06-82df-472a-b031-a983c173bd5e Jul 15 18:31:57 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:57 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-38713b06-82df-472a-b031-a983c173bd5e" returned: 0 in 1.052s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-38713b06-82df-472a-b031-a983c173bd5e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:58 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-38713b06-82df-472a-b031-a983c173bd5e Jul 15 18:31:58 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:31:58 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Jul 15 18:31:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-38713b06-82df-472a-b031-a983c173bd5e" returned: 0 in 0.581s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:31:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Lock "cinder-quobyte-38713b06-82df-472a-b031-a983c173bd5e" released by "delete_volume" :: held 1.744s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:31:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Acquiring lock "cinder-quobyte-5001607e-30f0-44c6-b67a-4a4919ea2715" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:31:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Lock "cinder-quobyte-5001607e-30f0-44c6-b67a-4a4919ea2715" acquired by "delete_volume" :: waited 0.054s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:31:58 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[93268c20-76b0-4e6b-b8ed-f0f0d1455de9]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:31:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5001607e-30f0-44c6-b67a-4a4919ea2715 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:31:59 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5001607e-30f0-44c6-b67a-4a4919ea2715 Jul 15 18:31:59 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:00 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5001607e-30f0-44c6-b67a-4a4919ea2715" returned: 0 in 1.545s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5001607e-30f0-44c6-b67a-4a4919ea2715 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:00 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5001607e-30f0-44c6-b67a-4a4919ea2715 Jul 15 18:32:00 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:01 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5001607e-30f0-44c6-b67a-4a4919ea2715" returned: 0 in 0.678s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Lock "cinder-quobyte-5001607e-30f0-44c6-b67a-4a4919ea2715" released by "delete_volume" :: held 2.471s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:01 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Created reservations ['bbb9419a-e593-4460-9ca4-3a7d5b5ef0cd'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:01 devstack cinder-volume[87217]: WARNING cinder.quota [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-750989216 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-750989216, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:32:01 devstack cinder-volume[87217]: WARNING cinder.quota [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-750989216 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-750989216, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:32:01 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Created reservations ['b8b230d3-c917-48f5-9a9e-9bc76df4b6a4', '5fd1440f-1747-414b-b98c-bf2a63f1fcb9', 'fd7073c5-690c-48e1-b3a6-ec9e62b315ff', '9cfdb59d-ba0d-4bd7-9544-978c22920007'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:01 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Created reservations ['4b0a9024-a107-4230-a06f-53491a98ec11', '28fefd4a-8c9b-4d49-ad48-a8b6c2000b10', 'fe1f46a0-767c-4454-bb4c-0bb0fc9c4a19', 'd816e906-345d-4199-ab00-aceb1a39e30c'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:01 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:32:01 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:02 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.411s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:02 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:02 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-968f35d2-0f78-44bd-b075-c526ef063314 tempest-GroupsTest-1478013934 None] Delete group completed successfully. Jul 15 18:32:08 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-dc7e3665-5d5c-4c0f-9f00-fb39ca4e55d6 req-f62dfec0-0d1a-4928-80f5-cec0ac34a880 tempest-ServerActionsTestOtherA-2063533124 None] Terminate volume connection completed successfully. Jul 15 18:32:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-dc7e3665-5d5c-4c0f-9f00-fb39ca4e55d6 req-f62dfec0-0d1a-4928-80f5-cec0ac34a880 tempest-ServerActionsTestOtherA-2063533124 None] Deleting attachment f2da7dd7-54c7-4637-b96e-a293591ed68e. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Flow 'volume_create_manager' (8958db81-d09d-46b0-abfa-ee8f04f88f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6668ea7d-68b1-4b98-8cd2-5ca2b5f9f677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6668ea7d-68b1-4b98-8cd2-5ca2b5f9f677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1958921412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7b29d5-f065-4487-b514-6742a306bd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f53b464c33346e69a2ba677f8b3c156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:11Z,use_quota=True,user_id='1ca1bcebc1eb4c4698defb61bd324d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8bcdf4-3304-4ece-9bf8-2bb7abd03daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8bcdf4-3304-4ece-9bf8-2bb7abd03daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ee15a9-bde6-40e7-ab32-1c703a0d2845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ee15a9-bde6-40e7-ab32-1c703a0d2845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e7b29d5-f065-4487-b514-6742a306bd3d', 'volume_name': 'volume-4e7b29d5-f065-4487-b514-6742a306bd3d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9695f4-d2aa-4a2b-bfc1-caa4a8c9434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9695f4-d2aa-4a2b-bfc1-caa4a8c9434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb8578f-9d43-4284-9228-a7470fd4f06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:11 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Volume 4e7b29d5-f065-4487-b514-6742a306bd3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e7b29d5-f065-4487-b514-6742a306bd3d', 'volume_size': 1} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1958921412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7b29d5-f065-4487-b514-6742a306bd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f53b464c33346e69a2ba677f8b3c156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:11Z,use_quota=True,user_id='1ca1bcebc1eb4c4698defb61bd324d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Creating volume 4e7b29d5-f065-4487-b514-6742a306bd3d {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:32:11 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:32:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4e7b29d5-f065-4487-b514-6742a306bd3d 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:11 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4e7b29d5-f065-4487-b514-6742a306bd3d 1073741824 Jul 15 18:32:11 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:12 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4e7b29d5-f065-4487-b514-6742a306bd3d 1073741824" returned: 0 in 1.142s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4e7b29d5-f065-4487-b514-6742a306bd3d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:12 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4e7b29d5-f065-4487-b514-6742a306bd3d Jul 15 18:32:13 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:13 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4e7b29d5-f065-4487-b514-6742a306bd3d" returned: 0 in 0.599s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:32:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb8578f-9d43-4284-9228-a7470fd4f06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7b29d5-f065-4487-b514-6742a306bd3d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70806a6-f8bb-47c9-be62-7c2569785378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:13 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Volume volume-4e7b29d5-f065-4487-b514-6742a306bd3d (4e7b29d5-f065-4487-b514-6742a306bd3d): created successfully Jul 15 18:32:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70806a6-f8bb-47c9-be62-7c2569785378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Flow 'volume_create_manager' (8958db81-d09d-46b0-abfa-ee8f04f88f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:13 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-28785cf9-515a-4847-99d6-9fe0608068a9 tempest-ServerRescueNegativeTestJSON-1324865974 None] Created volume successfully. Jul 15 18:32:13 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a2f8d356-4641-4df5-89b2-1c0df46377c9 tempest-GroupsV320Test-1392353854 None] Group tempest-GroupsV320Test-Group-1550740901: creating Jul 15 18:32:13 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a2f8d356-4641-4df5-89b2-1c0df46377c9 tempest-GroupsV320Test-1392353854 None] Group tempest-GroupsV320Test-Group-1550740901: created successfully Jul 15 18:32:13 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a2f8d356-4641-4df5-89b2-1c0df46377c9 tempest-GroupsV320Test-1392353854 None] Create group completed successfully. Jul 15 18:32:16 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-218f5e48-0667-4ee7-aa43-472839575a3b tempest-GroupsV320Test-1392353854 None] Created reservations ['900baeda-8c20-4dd9-8643-932f197110dd'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-218f5e48-0667-4ee7-aa43-472839575a3b tempest-GroupsV320Test-1392353854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-218f5e48-0667-4ee7-aa43-472839575a3b tempest-GroupsV320Test-1392353854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-218f5e48-0667-4ee7-aa43-472839575a3b tempest-GroupsV320Test-1392353854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-218f5e48-0667-4ee7-aa43-472839575a3b tempest-GroupsV320Test-1392353854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-218f5e48-0667-4ee7-aa43-472839575a3b tempest-GroupsV320Test-1392353854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-218f5e48-0667-4ee7-aa43-472839575a3b tempest-GroupsV320Test-1392353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:16 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:32:16 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Acquiring lock "cinder-17d33169-c2de-4aa0-9921-248378090b0c-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Lock "cinder-17d33169-c2de-4aa0-9921-248378090b0c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:17 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-218f5e48-0667-4ee7-aa43-472839575a3b tempest-GroupsV320Test-1392353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.724s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:17 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-218f5e48-0667-4ee7-aa43-472839575a3b tempest-GroupsV320Test-1392353854 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:17 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-218f5e48-0667-4ee7-aa43-472839575a3b tempest-GroupsV320Test-1392353854 None] Delete group completed successfully. Jul 15 18:32:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Acquiring lock "cinder-quobyte-17d33169-c2de-4aa0-9921-248378090b0c" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Lock "cinder-quobyte-17d33169-c2de-4aa0-9921-248378090b0c" acquired by "delete_volume" :: waited 0.058s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:17 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abdd973-44e9-426e-af40-b5cba491bcee]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:17 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c Jul 15 18:32:17 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:17 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c" returned: 0 in 0.636s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:17 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c Jul 15 18:32:17 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:18 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-17d33169-c2de-4aa0-9921-248378090b0c" returned: 0 in 0.743s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Lock "cinder-quobyte-17d33169-c2de-4aa0-9921-248378090b0c" released by "delete_volume" :: held 1.490s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:18 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Created reservations ['11559007-2f7b-41e6-b52c-f71d4279d7f9', 'c7f7867b-322f-4ebb-a711-056986496228', '51b471c6-b613-4bfc-bbe7-c08c463f707e', '9a05b3fb-3fe2-4f86-8987-559c631c11d5'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:19 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:32:19 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:19 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.618s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:19 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:19 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Deleted volume successfully. Jul 15 18:32:19 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0784e508-653a-4f28-aa38-6503a36d4402 tempest-ServerActionsTestOtherA-2063533124 None] Lock "cinder-17d33169-c2de-4aa0-9921-248378090b0c-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:28 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=31,cinder:UPDATE=36,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:32:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-012678ad-a6b2-4f8e-830b-442a36cc7dc6 req-9d80774b-0c4f-4bfa-bd75-ac4f372def05 tempest-TaggedAttachmentsTest-791709439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-012678ad-a6b2-4f8e-830b-442a36cc7dc6 req-9d80774b-0c4f-4bfa-bd75-ac4f372def05 tempest-TaggedAttachmentsTest-791709439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:29 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3882cf-ea91-4371-bdfa-6965683a68c3]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-012678ad-a6b2-4f8e-830b-442a36cc7dc6 req-9d80774b-0c4f-4bfa-bd75-ac4f372def05 tempest-TaggedAttachmentsTest-791709439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:29 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad Jul 15 18:32:29 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:29 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-012678ad-a6b2-4f8e-830b-442a36cc7dc6 req-9d80774b-0c4f-4bfa-bd75-ac4f372def05 tempest-TaggedAttachmentsTest-791709439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad" returned: 0 in 0.707s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-012678ad-a6b2-4f8e-830b-442a36cc7dc6 req-9d80774b-0c4f-4bfa-bd75-ac4f372def05 tempest-TaggedAttachmentsTest-791709439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.736s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-012678ad-a6b2-4f8e-830b-442a36cc7dc6 req-9d80774b-0c4f-4bfa-bd75-ac4f372def05 tempest-TaggedAttachmentsTest-791709439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b991973-1f2c-4127-9d6b-cbb19aedc1ce', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:32:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-012678ad-a6b2-4f8e-830b-442a36cc7dc6 req-9d80774b-0c4f-4bfa-bd75-ac4f372def05 tempest-TaggedAttachmentsTest-791709439 None] attachment_update completed successfully. Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Acquiring lock "cinder-4e7b29d5-f065-4487-b514-6742a306bd3d-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Lock "cinder-4e7b29d5-f065-4487-b514-6742a306bd3d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Acquiring lock "cinder-quobyte-4e7b29d5-f065-4487-b514-6742a306bd3d" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Lock "cinder-quobyte-4e7b29d5-f065-4487-b514-6742a306bd3d" acquired by "delete_volume" :: waited 0.053s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f3ee55-69be-41a1-875c-2791da992636]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4e7b29d5-f065-4487-b514-6742a306bd3d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:32 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4e7b29d5-f065-4487-b514-6742a306bd3d Jul 15 18:32:32 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:32 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:32:32 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:33 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.424s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:32:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 8 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:32:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:32:33 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4e7b29d5-f065-4487-b514-6742a306bd3d" returned: 0 in 0.937s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4e7b29d5-f065-4487-b514-6742a306bd3d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:33 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4e7b29d5-f065-4487-b514-6742a306bd3d Jul 15 18:32:33 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:33 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4e7b29d5-f065-4487-b514-6742a306bd3d" returned: 0 in 0.560s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:33 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Lock "cinder-quobyte-4e7b29d5-f065-4487-b514-6742a306bd3d" released by "delete_volume" :: held 1.597s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:33 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Created reservations ['ffcabf20-b08e-4a93-bd91-0c4c1f3c76be', '3eb67942-a275-4b10-90a8-d9c576db6f69', 'dfbed5f3-575c-4433-8780-221583e13c7d', 'ff538fb6-1976-4df7-b65f-a64a1d649fb5'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:34 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:32:34 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:34 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.530s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:34 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:34 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Deleted volume successfully. Jul 15 18:32:34 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-06e8bb98-d350-466d-b016-dbdf4af6c98c tempest-ServerRescueNegativeTestJSON-1324865974 None] Lock "cinder-4e7b29d5-f065-4487-b514-6742a306bd3d-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:36 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-5e62d0a8-13c3-4c22-a1e3-844b027641da req-69a7fc27-d701-41f9-bde0-5fab92353ed1 tempest-TaggedAttachmentsTest-791709439 None] Terminate volume connection completed successfully. Jul 15 18:32:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-5e62d0a8-13c3-4c22-a1e3-844b027641da req-69a7fc27-d701-41f9-bde0-5fab92353ed1 tempest-TaggedAttachmentsTest-791709439 None] Deleting attachment 0b991973-1f2c-4127-9d6b-cbb19aedc1ce. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:32:44 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=48,cinder:DELETE=3,cinder:SELECT=44,cinder:INSERT=11 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Flow 'volume_create_manager' (a12162ff-8e2b-4d4f-b215-bb907745847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3481b8bc-5f6e-4bd6-a7d8-c8d0bbfa9cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3481b8bc-5f6e-4bd6-a7d8-c8d0bbfa9cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-161776450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef710b3-e886-479b-9f3f-0f4df7821f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc070687b8740bd910ee4d933641c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:46Z,use_quota=True,user_id='03acc4d430dd4436949eacf3d928d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040d9e4d-b405-451b-872a-aaf511762e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040d9e4d-b405-451b-872a-aaf511762e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1494b59b-8ad2-48d6-a74f-6501dcae2465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1494b59b-8ad2-48d6-a74f-6501dcae2465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef710b3-e886-479b-9f3f-0f4df7821f92', 'volume_name': 'volume-cef710b3-e886-479b-9f3f-0f4df7821f92', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00609e1d-e373-4ef3-abe1-868d9e124e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00609e1d-e373-4ef3-abe1-868d9e124e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d02c49c-ac1a-47fd-b01b-0c76f3a0e267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:45 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Volume cef710b3-e886-479b-9f3f-0f4df7821f92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef710b3-e886-479b-9f3f-0f4df7821f92', 'volume_size': 1} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-161776450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef710b3-e886-479b-9f3f-0f4df7821f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc070687b8740bd910ee4d933641c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:46Z,use_quota=True,user_id='03acc4d430dd4436949eacf3d928d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Creating volume cef710b3-e886-479b-9f3f-0f4df7821f92 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:32:45 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:32:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cef710b3-e886-479b-9f3f-0f4df7821f92 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:45 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cef710b3-e886-479b-9f3f-0f4df7821f92 1073741824 Jul 15 18:32:45 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:46 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cef710b3-e886-479b-9f3f-0f4df7821f92 1073741824" returned: 0 in 0.525s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cef710b3-e886-479b-9f3f-0f4df7821f92 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:46 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cef710b3-e886-479b-9f3f-0f4df7821f92 Jul 15 18:32:46 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:46 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cef710b3-e886-479b-9f3f-0f4df7821f92" returned: 0 in 0.314s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:32:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d02c49c-ac1a-47fd-b01b-0c76f3a0e267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef710b3-e886-479b-9f3f-0f4df7821f92', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c35821-26c3-4797-8ee8-dae86bd89335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:46 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Volume volume-cef710b3-e886-479b-9f3f-0f4df7821f92 (cef710b3-e886-479b-9f3f-0f4df7821f92): created successfully Jul 15 18:32:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c35821-26c3-4797-8ee8-dae86bd89335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Flow 'volume_create_manager' (a12162ff-8e2b-4d4f-b215-bb907745847b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:46 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e5416bd9-eb50-41ed-b883-5948556886b8 tempest-VolumeQuotasAdminTestJSON-975875570 None] Created volume successfully. Jul 15 18:32:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Acquiring lock "cinder-cef710b3-e886-479b-9f3f-0f4df7821f92-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "cinder-cef710b3-e886-479b-9f3f-0f4df7821f92-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Acquiring lock "cinder-quobyte-cef710b3-e886-479b-9f3f-0f4df7821f92" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "cinder-quobyte-cef710b3-e886-479b-9f3f-0f4df7821f92" acquired by "delete_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:48 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb64f4e7-cd75-4e81-9d01-842c2a53c87a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cef710b3-e886-479b-9f3f-0f4df7821f92 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:48 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cef710b3-e886-479b-9f3f-0f4df7821f92 Jul 15 18:32:48 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:48 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cef710b3-e886-479b-9f3f-0f4df7821f92" returned: 0 in 0.474s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cef710b3-e886-479b-9f3f-0f4df7821f92 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:48 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cef710b3-e886-479b-9f3f-0f4df7821f92 Jul 15 18:32:48 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:48 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cef710b3-e886-479b-9f3f-0f4df7821f92" returned: 0 in 0.266s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "cinder-quobyte-cef710b3-e886-479b-9f3f-0f4df7821f92" released by "delete_volume" :: held 0.826s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Created reservations ['66195bf8-4eae-4427-8cb7-96631e17ccd9', 'bef7e356-a037-49c7-9f5b-86e3743f867f', 'b43aa24f-9eb2-4f1b-8e87-55dedfc2dcfe', 'ac44c888-fb87-463f-84fe-209e889c57ae'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:49 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:32:49 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:49 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.468s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:49 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Deleted volume successfully. Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdd61132-8ce5-4f9e-bf8c-cf91d10c22c0 tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "cinder-cef710b3-e886-479b-9f3f-0f4df7821f92-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Flow 'volume_create_manager' (64002fda-1efd-415e-9293-72d7dedd5314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba284ffb-24fd-4d2e-981e-df55ee9211fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba284ffb-24fd-4d2e-981e-df55ee9211fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-528853891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94949c86-d728-4e03-8e1f-52b2462b54ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc070687b8740bd910ee4d933641c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:50Z,use_quota=True,user_id='03acc4d430dd4436949eacf3d928d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27190e22-e2bc-4e53-b95a-cbe8d0fe2157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27190e22-e2bc-4e53-b95a-cbe8d0fe2157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4982d7be-08ac-464b-8f69-186aa9f2901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4982d7be-08ac-464b-8f69-186aa9f2901a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94949c86-d728-4e03-8e1f-52b2462b54ce', 'volume_name': 'volume-94949c86-d728-4e03-8e1f-52b2462b54ce', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dccda8d7-6bcb-4de6-842d-82abd4895c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dccda8d7-6bcb-4de6-842d-82abd4895c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611ab8e9-ea83-4915-836f-d1b9168c13e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:49 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Volume 94949c86-d728-4e03-8e1f-52b2462b54ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94949c86-d728-4e03-8e1f-52b2462b54ce', 'volume_size': 1} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-528853891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94949c86-d728-4e03-8e1f-52b2462b54ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc070687b8740bd910ee4d933641c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:50Z,use_quota=True,user_id='03acc4d430dd4436949eacf3d928d85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Creating volume 94949c86-d728-4e03-8e1f-52b2462b54ce {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:32:50 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94949c86-d728-4e03-8e1f-52b2462b54ce 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:50 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94949c86-d728-4e03-8e1f-52b2462b54ce 1073741824 Jul 15 18:32:50 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:50 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94949c86-d728-4e03-8e1f-52b2462b54ce 1073741824" returned: 0 in 0.575s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94949c86-d728-4e03-8e1f-52b2462b54ce {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:50 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94949c86-d728-4e03-8e1f-52b2462b54ce Jul 15 18:32:50 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:50 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94949c86-d728-4e03-8e1f-52b2462b54ce" returned: 0 in 0.315s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611ab8e9-ea83-4915-836f-d1b9168c13e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94949c86-d728-4e03-8e1f-52b2462b54ce', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae36a55-b275-4ce3-ac1a-add2d351777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:50 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Volume volume-94949c86-d728-4e03-8e1f-52b2462b54ce (94949c86-d728-4e03-8e1f-52b2462b54ce): created successfully Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae36a55-b275-4ce3-ac1a-add2d351777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Flow 'volume_create_manager' (64002fda-1efd-415e-9293-72d7dedd5314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:51 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4c8d01ee-3e45-4639-8d9f-0ba2b64f3eaa tempest-VolumeQuotasAdminTestJSON-975875570 None] Created volume successfully. Jul 15 18:32:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Acquiring lock "cinder-d120b488-a6ba-4034-9f35-3afbd8fe41ad-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Lock "cinder-d120b488-a6ba-4034-9f35-3afbd8fe41ad-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Acquiring lock "cinder-quobyte-d120b488-a6ba-4034-9f35-3afbd8fe41ad" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Lock "cinder-quobyte-d120b488-a6ba-4034-9f35-3afbd8fe41ad" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:51 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e923a0ab-05a4-4abf-af18-e45631c11db3]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:51 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad Jul 15 18:32:51 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:52 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad" returned: 0 in 0.715s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:52 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad Jul 15 18:32:52 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:52 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d120b488-a6ba-4034-9f35-3afbd8fe41ad" returned: 0 in 0.391s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Lock "cinder-quobyte-d120b488-a6ba-4034-9f35-3afbd8fe41ad" released by "delete_volume" :: held 1.173s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:52 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Created reservations ['c1e505b6-af88-408d-8682-57752fccd744', '4d318998-f528-4737-ab2c-571bbc0ada84', '20572c1c-f59c-4524-b249-529bf210bf36', 'bed46161-4879-4fc5-a164-aa04aaa2a6fb'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:52 devstack sudo[92115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:32:52 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:53 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.383s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:53 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:53 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Deleted volume successfully. Jul 15 18:32:53 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a0683efb-b64d-484f-83f3-8f7eef1a12e9 tempest-VolumeQuotasAdminTestJSON-1941791646 None] Transfer volume completed successfully. Jul 15 18:32:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3b0a5eb3-27bf-405a-9b48-161976ff0121 tempest-TaggedAttachmentsTest-791709439 None] Lock "cinder-d120b488-a6ba-4034-9f35-3afbd8fe41ad-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Acquiring lock "cinder-94949c86-d728-4e03-8e1f-52b2462b54ce-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Lock "cinder-94949c86-d728-4e03-8e1f-52b2462b54ce-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Acquiring lock "cinder-quobyte-94949c86-d728-4e03-8e1f-52b2462b54ce" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:32:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Lock "cinder-quobyte-94949c86-d728-4e03-8e1f-52b2462b54ce" acquired by "delete_volume" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:32:54 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f73a4f-73c6-4f3a-bd83-9316b81975b1]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:32:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94949c86-d728-4e03-8e1f-52b2462b54ce {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:54 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94949c86-d728-4e03-8e1f-52b2462b54ce Jul 15 18:32:54 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:54 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94949c86-d728-4e03-8e1f-52b2462b54ce" returned: 0 in 0.609s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94949c86-d728-4e03-8e1f-52b2462b54ce {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:54 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94949c86-d728-4e03-8e1f-52b2462b54ce Jul 15 18:32:54 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:55 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94949c86-d728-4e03-8e1f-52b2462b54ce" returned: 0 in 0.436s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Lock "cinder-quobyte-94949c86-d728-4e03-8e1f-52b2462b54ce" released by "delete_volume" :: held 1.120s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:55 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Created reservations ['81374f32-5a87-4bd8-88b1-cecfbcbbd98c', '5d5ccf94-5ec1-45e5-97cd-322222ce52d4', '6164b9bc-2e4c-4599-bed8-eebaf9dd8dd3', '06714aac-c17e-4a5e-9a8b-df429db75868'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:32:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:55 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:32:55 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:55 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1def8684-2e2a-45ce-bf20-91e0019b5d71 tempest-GroupSnapshotsV319Test-737321605 None] Group tempest-GroupSnapshotsV319Test-Group-531926766: creating Jul 15 18:32:55 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1def8684-2e2a-45ce-bf20-91e0019b5d71 tempest-GroupSnapshotsV319Test-737321605 None] Group tempest-GroupSnapshotsV319Test-Group-531926766: created successfully Jul 15 18:32:55 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1def8684-2e2a-45ce-bf20-91e0019b5d71 tempest-GroupSnapshotsV319Test-737321605 None] Create group completed successfully. Jul 15 18:32:55 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.291s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:55 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:32:55 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Deleted volume successfully. Jul 15 18:32:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-83284816-4834-4c8c-8c04-5516db568d89 tempest-VolumeQuotasAdminTestJSON-1470638488 None] Lock "cinder-94949c86-d728-4e03-8e1f-52b2462b54ce-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Flow 'volume_create_manager' (93329736-fa55-4160-b410-ff5348e77a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32fed59-30f4-4702-9086-503caf729e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32fed59-30f4-4702-9086-503caf729e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1036693264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63aa467d-cab4-43e6-8adc-2fa57430bc82,host='devstack@QuobyteHD#QuobyteHD',id=cf3302c4-cfe0-466b-88a0-df72f24875c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb221f10fce34ae08a724bd1aac6d3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:57Z,use_quota=True,user_id='a44be75497ca4f1c8a49a328f82a4865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(805ca9bd-8597-46de-bfb3-62e123e0057c),volume_type_id=805ca9bd-8597-46de-bfb3-62e123e0057c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761bc280-4454-4d17-968a-7e5cdb38dae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761bc280-4454-4d17-968a-7e5cdb38dae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be061790-37fb-40a7-9b04-47a153b0583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be061790-37fb-40a7-9b04-47a153b0583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3302c4-cfe0-466b-88a0-df72f24875c1', 'volume_name': 'volume-cf3302c4-cfe0-466b-88a0-df72f24875c1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f68643-fd6f-41ee-b9d5-8e48f9759fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f68643-fd6f-41ee-b9d5-8e48f9759fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c0b320-a62a-40bf-bfcc-1e84acfe12ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:57 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Volume cf3302c4-cfe0-466b-88a0-df72f24875c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3302c4-cfe0-466b-88a0-df72f24875c1', 'volume_size': 1} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63aa467d-cab4-43e6-8adc-2fa57430bc82,created_at=2026-07-15T16:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1036693264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63aa467d-cab4-43e6-8adc-2fa57430bc82,host='devstack@QuobyteHD#QuobyteHD',id=cf3302c4-cfe0-466b-88a0-df72f24875c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb221f10fce34ae08a724bd1aac6d3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:32:57Z,use_quota=True,user_id='a44be75497ca4f1c8a49a328f82a4865',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(805ca9bd-8597-46de-bfb3-62e123e0057c),volume_type_id=805ca9bd-8597-46de-bfb3-62e123e0057c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Creating volume cf3302c4-cfe0-466b-88a0-df72f24875c1 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:32:57 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:32:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:57 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 1073741824 Jul 15 18:32:57 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:58 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 1073741824" returned: 0 in 0.674s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:32:58 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 Jul 15 18:32:58 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:32:58 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Jul 15 18:32:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1" returned: 0 in 0.291s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:32:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:32:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:32:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c0b320-a62a-40bf-bfcc-1e84acfe12ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3302c4-cfe0-466b-88a0-df72f24875c1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1090c25e-549e-4135-82b7-7fde3f3a9bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:32:58 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Volume volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 (cf3302c4-cfe0-466b-88a0-df72f24875c1): created successfully Jul 15 18:32:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1090c25e-549e-4135-82b7-7fde3f3a9bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:32:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Flow 'volume_create_manager' (93329736-fa55-4160-b410-ff5348e77a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:32:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-838dcc59-d728-40c1-87a6-75ed1a526b8c tempest-GroupSnapshotsV319Test-737321605 None] Created volume successfully. Jul 15 18:33:00 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] GroupSnapshot 08a6f674-0351-449c-a6b3-483e9d9d49ca: creating. Jul 15 18:33:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] Group snapshot 08a6f674-0351-449c-a6b3-483e9d9d49ca: creating. {{(pid=87217) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 15 18:33:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] Creating offline snapshot c894f6ff-b14d-4117-a642-9d4567f213df of volume cf3302c4-cfe0-466b-88a0-df72f24875c1 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:33:00 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bb083d-6a20-4264-9428-cd07f7806be4]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:00 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 Jul 15 18:33:00 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:00 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1" returned: 0 in 0.480s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:00 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df 1G Jul 15 18:33:00 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:01 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df 1G" returned: 0 in 0.535s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:01 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df Jul 15 18:33:01 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:01 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df" returned: 0 in 0.364s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:01 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:33:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:01 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df Jul 15 18:33:01 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:02 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df" returned: 0 in 0.323s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:02 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.info Jul 15 18:33:02 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:02 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.info" returned: 0 in 0.316s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:02 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:33:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:02 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.info Jul 15 18:33:02 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:02 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.info" returned: 0 in 0.252s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.412s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:02 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-69025124-263c-4264-8c4a-3eeeb2d0cd41 tempest-GroupSnapshotsV319Test-737321605 None] group_snapshot 08a6f674-0351-449c-a6b3-483e9d9d49ca: created successfully Jul 15 18:33:04 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] group_snapshot 08a6f674-0351-449c-a6b3-483e9d9d49ca: deleting Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] group_snapshot 08a6f674-0351-449c-a6b3-483e9d9d49ca: deleting {{(pid=87217) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Acquiring lock "cinder-quobyte-cf3302c4-cfe0-466b-88a0-df72f24875c1" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Lock "cinder-quobyte-cf3302c4-cfe0-466b-88a0-df72f24875c1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Acquiring lock "cinder-quobyte-c894f6ff-b14d-4117-a642-9d4567f213df" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Lock "cinder-quobyte-c894f6ff-b14d-4117-a642-9d4567f213df" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Deleting offline snapshot c894f6ff-b14d-4117-a642-9d4567f213df of volume cf3302c4-cfe0-466b-88a0-df72f24875c1 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] snapshot_file for this snap is: volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc261c6-9ca3-41f2-b800-7bcb9bf839cd]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:04 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df Jul 15 18:33:04 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:04 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df" returned: 0 in 0.587s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf3302c4-cfe0-466b-88a0-df72f24875c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aee8c34-6796-438b-9cca-98cfd9017447]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:05 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 Jul 15 18:33:05 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:05 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1" returned: 0 in 0.525s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:05 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df Jul 15 18:33:05 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:05 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df" returned: 0 in 0.478s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:05 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df Jul 15 18:33:05 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:06 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1.c894f6ff-b14d-4117-a642-9d4567f213df" returned: 0 in 0.324s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Lock "cinder-quobyte-c894f6ff-b14d-4117-a642-9d4567f213df" released by "_delete_snapshot" :: held 2.068s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Lock "cinder-quobyte-cf3302c4-cfe0-466b-88a0-df72f24875c1" released by "delete_snapshot" :: held 2.114s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:06 devstack cinder-volume[87217]: WARNING cinder.quota [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1611633459 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1611633459, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:33:06 devstack cinder-volume[87217]: WARNING cinder.quota [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1611633459 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1611633459, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:33:06 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] Created reservations ['f2242b3f-67d9-46ef-8ae7-c89230c6c41a', '4ecbd3ba-8a6d-47ff-999e-9b44deec7a81', 'e0163706-6f9a-4969-8585-378ce32792ba', '1f1972e4-4ddd-4dea-8739-a008a0ce5ded'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:06 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-dc7ccaee-fd55-41a0-98d3-cf13a99d5af6 tempest-GroupSnapshotsV319Test-737321605 None] group_snapshot 08a6f674-0351-449c-a6b3-483e9d9d49ca: deleted successfully Jul 15 18:33:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Acquiring lock "cinder-quobyte-cf3302c4-cfe0-466b-88a0-df72f24875c1" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Lock "cinder-quobyte-cf3302c4-cfe0-466b-88a0-df72f24875c1" acquired by "delete_volume" :: waited 0.027s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:08 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bce9e31-fd5c-46d9-96d4-4b27284c0a7b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:08 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 Jul 15 18:33:08 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:08 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1" returned: 0 in 0.537s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:08 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1 Jul 15 18:33:08 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:08 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:33:08 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Flow 'volume_create_manager' (32d2b9c7-f2bf-4c79-bac8-0e0c327ce4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb97a323-a918-47c1-bf0e-1bef70a5bdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cf3302c4-cfe0-466b-88a0-df72f24875c1" returned: 0 in 0.315s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb97a323-a918-47c1-bf0e-1bef70a5bdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2140636191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539bf3ff-e7f8-41c4-87c6-d74fbab7f40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='897555d63d174d48ad594f611394204e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:09Z,use_quota=True,user_id='d7f6e18def0f475dab873264cbb47d45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7887fc8e-1ad2-4bff-a206-d1f18f177c8b),volume_type_id=7887fc8e-1ad2-4bff-a206-d1f18f177c8b)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872d7337-bfdb-4323-9279-a3e32e97539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872d7337-bfdb-4323-9279-a3e32e97539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d504751-1971-4719-b2d7-1d285b612bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d504751-1971-4719-b2d7-1d285b612bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '539bf3ff-e7f8-41c4-87c6-d74fbab7f40a', 'volume_name': 'volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1adc17-4cf1-4e2e-8318-c50ca961b2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1adc17-4cf1-4e2e-8318-c50ca961b2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b49b1e-65de-4306-8feb-328e52f87ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:09 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Volume 539bf3ff-e7f8-41c4-87c6-d74fbab7f40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a', 'volume_size': 1} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2140636191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539bf3ff-e7f8-41c4-87c6-d74fbab7f40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='897555d63d174d48ad594f611394204e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:09Z,use_quota=True,user_id='d7f6e18def0f475dab873264cbb47d45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7887fc8e-1ad2-4bff-a206-d1f18f177c8b),volume_type_id=7887fc8e-1ad2-4bff-a206-d1f18f177c8b)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Creating volume 539bf3ff-e7f8-41c4-87c6-d74fbab7f40a {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:33:09 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Lock "cinder-quobyte-cf3302c4-cfe0-466b-88a0-df72f24875c1" released by "delete_volume" :: held 1.031s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:09 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a 1073741824 Jul 15 18:33:09 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Created reservations ['7382604a-5e1a-4240-b820-3a6df0817927'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:09 devstack cinder-volume[87217]: WARNING cinder.quota [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1611633459 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1611633459, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Created reservations ['83a3c39b-5bb6-48d4-afdc-48c69fd17998', 'c0d9efe0-ec25-4424-99bb-dc33de16a5f6', '4716559b-ab39-409e-9cbf-7824df83a1c4', '6219a846-6f59-4a73-8aec-5b4abc636663'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:09 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:33:09 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:09 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a 1073741824" returned: 0 in 0.616s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:09 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a Jul 15 18:33:09 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:09 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.398s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:09 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:09 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-adaacd8b-63ca-4b73-b620-7802b9c38ae1 tempest-GroupSnapshotsV319Test-737321605 None] Delete group completed successfully. Jul 15 18:33:10 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a" returned: 0 in 0.369s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:33:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b49b1e-65de-4306-8feb-328e52f87ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b311b6f1-292f-4dc5-8a5b-3042b67c7b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:10 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Volume volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a (539bf3ff-e7f8-41c4-87c6-d74fbab7f40a): created successfully Jul 15 18:33:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b311b6f1-292f-4dc5-8a5b-3042b67c7b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Flow 'volume_create_manager' (32d2b9c7-f2bf-4c79-bac8-0e0c327ce4b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:10 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4593545f-2160-4f41-8c0d-1eca4cd61042 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Created volume successfully. Jul 15 18:33:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-379df68a-84b8-4959-affe-3cf0ee1f3bbd tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-379df68a-84b8-4959-affe-3cf0ee1f3bbd tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-379df68a-84b8-4959-affe-3cf0ee1f3bbd tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-379df68a-84b8-4959-affe-3cf0ee1f3bbd tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-379df68a-84b8-4959-affe-3cf0ee1f3bbd tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-379df68a-84b8-4959-affe-3cf0ee1f3bbd tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:11 devstack sudo[92305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:33:11 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:12 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-379df68a-84b8-4959-affe-3cf0ee1f3bbd tempest-VolumeRetypeWithoutMigrationTest-832122576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.403s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:12 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-379df68a-84b8-4959-affe-3cf0ee1f3bbd tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:12 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-379df68a-84b8-4959-affe-3cf0ee1f3bbd tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Retype volume completed successfully. Jul 15 18:33:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Acquiring lock "cinder-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Lock "cinder-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Acquiring lock "cinder-quobyte-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Lock "cinder-quobyte-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:13 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6241c783-a33a-4d46-9858-2df130114503]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:13 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a Jul 15 18:33:13 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:13 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a" returned: 0 in 0.467s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:13 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a Jul 15 18:33:13 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:14 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a" returned: 0 in 0.308s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Lock "cinder-quobyte-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a" released by "delete_volume" :: held 0.863s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:14 devstack cinder-volume[87217]: WARNING cinder.quota [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:33:14 devstack cinder-volume[87217]: WARNING cinder.quota [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:33:14 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Created reservations ['00a652f4-bf53-4d08-b9c1-25bbaa7c52d4', '1bf33aba-a40c-4b1e-ba30-b1226f869d86', '9e388702-a0cb-4cc4-81a2-1772f7cd20c3', '89d5b449-2587-4291-ac89-56dfba978c91'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:14 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:33:14 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:14 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.446s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:14 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:14 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Deleted volume successfully. Jul 15 18:33:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-18090877-da0c-494e-b3ec-6f0516ab9c41 tempest-VolumeRetypeWithoutMigrationTest-832122576 None] Lock "cinder-539bf3ff-e7f8-41c4-87c6-d74fbab7f40a-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:19 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6ca4ab3e-d707-4743-83b2-9ba9356a27d2 tempest-GroupsV314Test-511647055 None] Group tempest-GroupsV314Test-Group-1786692344: creating Jul 15 18:33:19 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6ca4ab3e-d707-4743-83b2-9ba9356a27d2 tempest-GroupsV314Test-511647055 None] Group tempest-GroupsV314Test-Group-1786692344: created successfully Jul 15 18:33:19 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6ca4ab3e-d707-4743-83b2-9ba9356a27d2 tempest-GroupsV314Test-511647055 None] Create group completed successfully. Jul 15 18:33:21 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:33:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Flow 'volume_create_manager' (0c69e0be-ebf7-414e-8fee-038bdd6249ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f4540e-8f7e-4f6d-8b2a-895c335801fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f4540e-8f7e-4f6d-8b2a-895c335801fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865434031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a2c5941-8a47-4698-b52d-88515f591b2a,host='devstack@QuobyteHD#QuobyteHD',id=d68008de-c208-4fc7-8b14-fcc2713ed96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1412326ba3874261aa4a968de8aef29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:22Z,use_quota=True,user_id='1be41f5e2eb54073b7d84a3bdea571f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b144511c-17ba-4ffe-b17d-435f020fa88e),volume_type_id=b144511c-17ba-4ffe-b17d-435f020fa88e)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff21a837-6332-4879-aaf8-0f18b4b08274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff21a837-6332-4879-aaf8-0f18b4b08274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bc327d-a1cf-4096-835e-e2d1daa9ac90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bc327d-a1cf-4096-835e-e2d1daa9ac90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd68008de-c208-4fc7-8b14-fcc2713ed96c', 'volume_name': 'volume-d68008de-c208-4fc7-8b14-fcc2713ed96c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e136e1-456f-480e-9d33-2de349daa342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e136e1-456f-480e-9d33-2de349daa342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca105fd-3160-4557-8816-2877f1fa9deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:22 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Volume d68008de-c208-4fc7-8b14-fcc2713ed96c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d68008de-c208-4fc7-8b14-fcc2713ed96c', 'volume_size': 1} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a2c5941-8a47-4698-b52d-88515f591b2a,created_at=2026-07-15T16:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865434031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a2c5941-8a47-4698-b52d-88515f591b2a,host='devstack@QuobyteHD#QuobyteHD',id=d68008de-c208-4fc7-8b14-fcc2713ed96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1412326ba3874261aa4a968de8aef29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:22Z,use_quota=True,user_id='1be41f5e2eb54073b7d84a3bdea571f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b144511c-17ba-4ffe-b17d-435f020fa88e),volume_type_id=b144511c-17ba-4ffe-b17d-435f020fa88e)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Creating volume d68008de-c208-4fc7-8b14-fcc2713ed96c {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:33:22 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:22 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c 1073741824 Jul 15 18:33:22 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:22 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c 1073741824" returned: 0 in 0.691s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:22 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c Jul 15 18:33:22 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:23 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c" returned: 0 in 0.322s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:33:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca105fd-3160-4557-8816-2877f1fa9deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d68008de-c208-4fc7-8b14-fcc2713ed96c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c74ff33-481a-45e0-b6bf-947e9161ea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:23 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Volume volume-d68008de-c208-4fc7-8b14-fcc2713ed96c (d68008de-c208-4fc7-8b14-fcc2713ed96c): created successfully Jul 15 18:33:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c74ff33-481a-45e0-b6bf-947e9161ea73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Flow 'volume_create_manager' (0c69e0be-ebf7-414e-8fee-038bdd6249ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:23 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-11793791-224a-43a2-b014-fcd927105af4 tempest-GroupsV314Test-511647055 None] Created volume successfully. Jul 15 18:33:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:25 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Cloning volume d68008de-c208-4fc7-8b14-fcc2713ed96c to volume c84dcd04-02c2-4300-8b6d-5babd0ac848b Jul 15 18:33:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Creating offline snapshot c088d9dd-cbe5-4478-bd21-a64796a99f46 of volume d68008de-c208-4fc7-8b14-fcc2713ed96c {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:33:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec9f306-e983-48cb-9628-1ac6c5f310b9]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:25 devstack sudo[92369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c Jul 15 18:33:25 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:26 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c" returned: 0 in 0.548s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:26 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 1G Jul 15 18:33:26 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:26 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 1G" returned: 0 in 0.612s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d68008de-c208-4fc7-8b14-fcc2713ed96c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:26 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d68008de-c208-4fc7-8b14-fcc2713ed96c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 Jul 15 18:33:26 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:26 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d68008de-c208-4fc7-8b14-fcc2713ed96c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46" returned: 0 in 0.358s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:26 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:33:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:27 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 Jul 15 18:33:27 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:27 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46" returned: 0 in 0.314s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:27 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.info Jul 15 18:33:27 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:27 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.info" returned: 0 in 0.282s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:27 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:27 devstack sudo[92391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.info Jul 15 18:33:27 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:27 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.info" returned: 0 in 0.266s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Acquiring lock "cinder-quobyte-c84dcd04-02c2-4300-8b6d-5babd0ac848b" by "_copy_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Lock "cinder-quobyte-c84dcd04-02c2-4300-8b6d-5babd0ac848b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] snapshot: c088d9dd-cbe5-4478-bd21-a64796a99f46, volume: c84dcd04-02c2-4300-8b6d-5babd0ac848b, {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7249928-eb7a-4cac-8360-d6bf7d91ce04]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:28 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 Jul 15 18:33:28 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:28 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46" returned: 0 in 0.458s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d68008de-c208-4fc7-8b14-fcc2713ed96c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:33:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:33:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Creating direct copy from snapshot {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:33:28 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[429015a0-4007-4992-a70c-1c22c78dd6d6]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:28 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c Jul 15 18:33:28 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:28 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c" returned: 0 in 0.437s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:28 devstack cinder-volume[87217]: DEBUG cinder.utils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Path /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b not found in is_blk_device check {{(pid=87217) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:33:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:28 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b Jul 15 18:33:28 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:33:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:32 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:33:32 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:33 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.777s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:33:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 8 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:33:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:33:34 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b" returned: 0 in 6.073s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df94225-49ab-4bc9-abf9-852bb91797b3]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:35 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c Jul 15 18:33:35 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Flow 'volume_create_manager' (f61a2e9b-9631-495d-8e11-11b0b9e8676c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca98cec8-d474-4a71-a7f0-a926ae3f458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca98cec8-d474-4a71-a7f0-a926ae3f458f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-929111822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01b9aaf-c110-4431-8f56-c337082d928e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd10324fa3fe4732a252981186c95ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:35Z,use_quota=True,user_id='b55261b14a2d4c518d920bc75f6ff907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5341a6b-96ce-4dfe-b8ad-eba1564b29f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5341a6b-96ce-4dfe-b8ad-eba1564b29f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26e94a2-3d55-432d-94d9-533d4d97464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26e94a2-3d55-432d-94d9-533d4d97464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01b9aaf-c110-4431-8f56-c337082d928e', 'volume_name': 'volume-b01b9aaf-c110-4431-8f56-c337082d928e', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89704a7-65ad-4ff3-93b2-4b8d21e45f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89704a7-65ad-4ff3-93b2-4b8d21e45f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0706f8e2-0a80-47c0-8afe-87c911ad8984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:35 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Volume b01b9aaf-c110-4431-8f56-c337082d928e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01b9aaf-c110-4431-8f56-c337082d928e', 'volume_size': 1} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:35 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c" returned: 0 in 0.614s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:33:35 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Converted 1024.00 MB image at 168.58 MB/s Jul 15 18:33:35 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:35 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b Jul 15 18:33:35 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:35 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b" returned: 0 in 0.243s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Lock "cinder-quobyte-c84dcd04-02c2-4300-8b6d-5babd0ac848b" released by "_copy_volume_from_snapshot" :: held 7.960s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=75,cinder:UPDATE=78,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Acquiring lock "cinder-quobyte-c088d9dd-cbe5-4478-bd21-a64796a99f46" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Lock "cinder-quobyte-c088d9dd-cbe5-4478-bd21-a64796a99f46" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Deleting offline snapshot c088d9dd-cbe5-4478-bd21-a64796a99f46 of volume d68008de-c208-4fc7-8b14-fcc2713ed96c {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] snapshot_file for this snap is: volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16e4693-f938-4623-afa4-d7d92ef0c545]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:36 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 Jul 15 18:33:36 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:36 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46" returned: 0 in 0.430s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d68008de-c208-4fc7-8b14-fcc2713ed96c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:33:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f631a240-d62e-4fa8-a37b-54f70fde4f89]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:36 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c Jul 15 18:33:36 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:36 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c" returned: 0 in 0.409s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:36 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 Jul 15 18:33:36 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:37 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46" returned: 0 in 0.425s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:37 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46 Jul 15 18:33:37 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:37 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c.c088d9dd-cbe5-4478-bd21-a64796a99f46" returned: 0 in 0.301s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Lock "cinder-quobyte-c088d9dd-cbe5-4478-bd21-a64796a99f46" released by "_delete_snapshot" :: held 1.669s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.296s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.046s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-929111822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01b9aaf-c110-4431-8f56-c337082d928e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd10324fa3fe4732a252981186c95ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:35Z,use_quota=True,user_id='b55261b14a2d4c518d920bc75f6ff907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Creating volume b01b9aaf-c110-4431-8f56-c337082d928e {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:33:37 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:33:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:37 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e 1073741824 Jul 15 18:33:37 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-834e2030-ed2f-4c86-b015-4b82a1f70d9f tempest-GroupsV314Test-511647055 None] Create group from source-group-5a2c5941-8a47-4698-b52d-88515f591b2a completed successfully. Jul 15 18:33:38 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e 1073741824" returned: 0 in 0.631s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Acquiring lock "cinder-quobyte-c84dcd04-02c2-4300-8b6d-5babd0ac848b" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:38 devstack sudo[92539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e Jul 15 18:33:38 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Lock "cinder-quobyte-c84dcd04-02c2-4300-8b6d-5babd0ac848b" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c4ce91-f74b-4d6d-88f0-4fcf610107cd]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:38 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b Jul 15 18:33:38 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:38 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e" returned: 0 in 0.334s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0706f8e2-0a80-47c0-8afe-87c911ad8984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01b9aaf-c110-4431-8f56-c337082d928e', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16cab51-06d0-4990-8ad3-64d43028a99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:38 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Volume volume-b01b9aaf-c110-4431-8f56-c337082d928e (b01b9aaf-c110-4431-8f56-c337082d928e): created successfully Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16cab51-06d0-4990-8ad3-64d43028a99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Flow 'volume_create_manager' (f61a2e9b-9631-495d-8e11-11b0b9e8676c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:38 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9cdf2d44-2901-4b3e-a868-4ec58cd717f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Created volume successfully. Jul 15 18:33:39 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b" returned: 0 in 0.607s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:39 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b Jul 15 18:33:39 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Flow 'volume_create_manager' (122d1a94-0809-470e-b398-6110fe23f71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36b153a-38e7-4854-8246-7960de0cae07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36b153a-38e7-4854-8246-7960de0cae07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-45175833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269148e2-656d-45e3-9689-27417a550c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e219988533374ca8bf85428b5726575b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:39Z,use_quota=True,user_id='9dda7e90bfaf435daf64eb19ad8742e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a748d360-fe64-4e6a-9da5-ac18d9e4ab5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a748d360-fe64-4e6a-9da5-ac18d9e4ab5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1a763c-0bd8-41e9-8bb5-9fed7b9a5291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1a763c-0bd8-41e9-8bb5-9fed7b9a5291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '269148e2-656d-45e3-9689-27417a550c37', 'volume_name': 'volume-269148e2-656d-45e3-9689-27417a550c37', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a6cf50-caf0-4f7f-8c9a-4d8720d01fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a6cf50-caf0-4f7f-8c9a-4d8720d01fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b1a642-51e4-40f2-aa12-45442d35c58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:39 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Volume 269148e2-656d-45e3-9689-27417a550c37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-269148e2-656d-45e3-9689-27417a550c37', 'volume_size': 1} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-45175833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269148e2-656d-45e3-9689-27417a550c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e219988533374ca8bf85428b5726575b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:39Z,use_quota=True,user_id='9dda7e90bfaf435daf64eb19ad8742e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Creating volume 269148e2-656d-45e3-9689-27417a550c37 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:33:39 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:39 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37 1073741824 Jul 15 18:33:39 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:39 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c84dcd04-02c2-4300-8b6d-5babd0ac848b" returned: 0 in 0.269s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Lock "cinder-quobyte-c84dcd04-02c2-4300-8b6d-5babd0ac848b" released by "delete_volume" :: held 0.939s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Created reservations ['c4031a44-bff2-475c-aa09-f11b5bac9ada'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:39 devstack cinder-volume[87217]: WARNING cinder.quota [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1518282262 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1518282262, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:33:39 devstack cinder-volume[87217]: WARNING cinder.quota [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1518282262 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1518282262, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Created reservations ['faa812cf-90e8-431e-8532-56a580c9ee65', '38c5f372-7050-4beb-a3a6-123ff2b75104', '7f8fac22-1da0-44ed-859a-bfd5bc69af34', '3a524abf-a4ad-4cf7-b361-59d7c82de1b3'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:39 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:33:39 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:39 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37 1073741824" returned: 0 in 0.769s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:40 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37 Jul 15 18:33:40 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:40 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.600s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:40 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6b0c1f5e-8b93-40be-ac11-e9bfe875efd0 tempest-GroupsV314Test-511647055 None] Delete group completed successfully. Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:40 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37" returned: 0 in 0.653s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.245s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Creating offline snapshot 7754c7d4-98e5-434f-814f-0cfeabd6b45e of volume b01b9aaf-c110-4431-8f56-c337082d928e {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b1a642-51e4-40f2-aa12-45442d35c58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269148e2-656d-45e3-9689-27417a550c37', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e393b47-c3fe-4c1f-9829-3450c2ace309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56145dd-2a43-4112-a67c-1992f6752757]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:40 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Volume volume-269148e2-656d-45e3-9689-27417a550c37 (269148e2-656d-45e3-9689-27417a550c37): created successfully Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e393b47-c3fe-4c1f-9829-3450c2ace309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Flow 'volume_create_manager' (122d1a94-0809-470e-b398-6110fe23f71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:40 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-799eba25-e4ae-40e2-8803-c144a7f6d821 tempest-AttachVolumeTestJSON-479770664 None] Created volume successfully. Jul 15 18:33:40 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e Jul 15 18:33:40 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Acquiring lock "cinder-quobyte-d68008de-c208-4fc7-8b14-fcc2713ed96c" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Lock "cinder-quobyte-d68008de-c208-4fc7-8b14-fcc2713ed96c" acquired by "delete_volume" :: waited 0.055s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:41 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c41451f-3d38-45d0-a17c-5a68c7dce1e5]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:41 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c Jul 15 18:33:41 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:41 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e" returned: 0 in 0.786s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:41 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e 1G Jul 15 18:33:41 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:41 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c" returned: 0 in 0.636s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:41 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c Jul 15 18:33:41 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:42 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e 1G" returned: 0 in 0.633s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01b9aaf-c110-4431-8f56-c337082d928e -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:42 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01b9aaf-c110-4431-8f56-c337082d928e -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e Jul 15 18:33:42 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:42 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d68008de-c208-4fc7-8b14-fcc2713ed96c" returned: 0 in 0.415s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Lock "cinder-quobyte-d68008de-c208-4fc7-8b14-fcc2713ed96c" released by "delete_volume" :: held 1.151s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Created reservations ['04a8a86c-db97-4595-b0aa-88ac02c37dc7'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Created reservations ['002077c6-c3a0-43d5-80f4-3344509e2f60', '789e132a-153c-4ddf-8b75-91b35a52a183', '6e14aeee-1209-4cc5-ab57-8e44a531852f', 'f8298ea3-c076-44ee-89e0-aae66e380617'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-325683ff-6289-4a09-b462-8de83fefb850 req-c8fec2c0-40f1-4524-8d12-30285e708bbf tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:42 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b01b9aaf-c110-4431-8f56-c337082d928e -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e" returned: 0 in 0.573s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:42 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e is being set with open permissions: ugo+rw Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:42 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e Jul 15 18:33:42 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:42 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:33:42 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:43 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e" returned: 0 in 0.384s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:43 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.info Jul 15 18:33:43 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:43 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.395s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:43 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:43 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-118740aa-64aa-4ff4-b6a6-c62ea80e3eb4 tempest-GroupsV314Test-511647055 None] Delete group completed successfully. Jul 15 18:33:43 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.info" returned: 0 in 0.309s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:43 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.info is being set with open permissions: ugo+rw Jul 15 18:33:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:43 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.info Jul 15 18:33:43 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:43 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.info" returned: 0 in 0.344s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.211s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-325683ff-6289-4a09-b462-8de83fefb850 req-c8fec2c0-40f1-4524-8d12-30285e708bbf tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.157s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:43 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[34942f2c-fb73-47c8-9229-ecaf52db13b6]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-325683ff-6289-4a09-b462-8de83fefb850 req-c8fec2c0-40f1-4524-8d12-30285e708bbf tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:43 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f6370449-835c-43f4-918c-799cefd0eda2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Create snapshot completed successfully Jul 15 18:33:44 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37 Jul 15 18:33:44 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:44 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-325683ff-6289-4a09-b462-8de83fefb850 req-c8fec2c0-40f1-4524-8d12-30285e708bbf tempest-AttachVolumeTestJSON-479770664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37" returned: 0 in 0.576s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-325683ff-6289-4a09-b462-8de83fefb850 req-c8fec2c0-40f1-4524-8d12-30285e708bbf tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.605s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-325683ff-6289-4a09-b462-8de83fefb850 req-c8fec2c0-40f1-4524-8d12-30285e708bbf tempest-AttachVolumeTestJSON-479770664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-269148e2-656d-45e3-9689-27417a550c37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb9054ca-0317-4c70-ba8e-5200e7d423f0', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:33:44 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-325683ff-6289-4a09-b462-8de83fefb850 req-c8fec2c0-40f1-4524-8d12-30285e708bbf tempest-AttachVolumeTestJSON-479770664 None] attachment_update completed successfully. Jul 15 18:33:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Acquiring lock "cinder-7754c7d4-98e5-434f-814f-0cfeabd6b45e-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "cinder-7754c7d4-98e5-434f-814f-0cfeabd6b45e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Acquiring lock "cinder-quobyte-b01b9aaf-c110-4431-8f56-c337082d928e" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "cinder-quobyte-b01b9aaf-c110-4431-8f56-c337082d928e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Acquiring lock "cinder-quobyte-7754c7d4-98e5-434f-814f-0cfeabd6b45e" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "cinder-quobyte-7754c7d4-98e5-434f-814f-0cfeabd6b45e" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Deleting offline snapshot 7754c7d4-98e5-434f-814f-0cfeabd6b45e of volume b01b9aaf-c110-4431-8f56-c337082d928e {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:33:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] snapshot_file for this snap is: volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:33:45 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2e15c8-477a-4854-a43a-d624884fae9b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:45 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e Jul 15 18:33:45 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:46 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e" returned: 0 in 0.509s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b01b9aaf-c110-4431-8f56-c337082d928e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:33:46 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[061645d6-4549-45d1-b05c-f54e016730e8]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:46 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e Jul 15 18:33:46 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:46 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e" returned: 0 in 0.453s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:46 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e Jul 15 18:33:46 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:47 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e" returned: 0 in 0.503s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:47 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e Jul 15 18:33:47 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:47 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e.7754c7d4-98e5-434f-814f-0cfeabd6b45e" returned: 0 in 0.421s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:47 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=103,cinder:UPDATE=111,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:33:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "cinder-quobyte-7754c7d4-98e5-434f-814f-0cfeabd6b45e" released by "_delete_snapshot" :: held 2.100s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "cinder-quobyte-b01b9aaf-c110-4431-8f56-c337082d928e" released by "delete_snapshot" :: held 2.163s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:47 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Created reservations ['431daa8b-0463-4a99-9e5e-88cc60db5722', 'cfce1efa-1fbc-4013-93af-66d38b4f0c98', '7c577378-f7dd-4140-9b7c-413cf54d4404', '0e261eeb-3bf6-43bf-9caa-1c29ccc35888'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:47 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Delete snapshot completed successfully. Jul 15 18:33:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ae0aa819-1c37-4f5b-936d-a432cf2151d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "cinder-7754c7d4-98e5-434f-814f-0cfeabd6b45e-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Acquiring lock "cinder-b01b9aaf-c110-4431-8f56-c337082d928e-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "cinder-b01b9aaf-c110-4431-8f56-c337082d928e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Acquiring lock "cinder-quobyte-b01b9aaf-c110-4431-8f56-c337082d928e" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:33:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "cinder-quobyte-b01b9aaf-c110-4431-8f56-c337082d928e" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:33:48 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674d815-3ca4-4b39-85d4-cb71729d4865]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:49 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e Jul 15 18:33:49 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:49 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e" returned: 0 in 0.603s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:49 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e Jul 15 18:33:49 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:49 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b01b9aaf-c110-4431-8f56-c337082d928e" returned: 0 in 0.358s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "cinder-quobyte-b01b9aaf-c110-4431-8f56-c337082d928e" released by "delete_volume" :: held 1.049s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:50 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Created reservations ['5bbb4f54-5071-4971-a558-d31f1e1c26d5', '4c3d964e-d3e8-4513-bc7d-965daac23c19', '201e7edf-4961-46b1-b903-44dcb0b6c737', '59fc5226-0760-49f4-ba0c-75dc5046f927'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:33:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:50 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:33:50 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:50 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.710s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:50 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:33:50 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Deleted volume successfully. Jul 15 18:33:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8e8dcbff-c2c1-4b1e-a10e-207a2abd2c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1361459088 None] Lock "cinder-b01b9aaf-c110-4431-8f56-c337082d928e-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Flow 'volume_create_manager' (ed9fdff8-df22-401f-8b22-27f3a31fae2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce1bb45-e934-4297-85f3-6ad140bc9553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce1bb45-e934-4297-85f3-6ad140bc9553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1182051500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b39042-5f56-444f-a846-a96734e9ae12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9f9dd18b31488895455171bc78703b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:52Z,use_quota=True,user_id='cc38e89d5e024c87b7229bb2d4d0b778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b42e41-84b4-4f1c-b1bb-0dfe24849901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b42e41-84b4-4f1c-b1bb-0dfe24849901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af5f3f7-1aaf-47cb-a156-693fa5477c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af5f3f7-1aaf-47cb-a156-693fa5477c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b39042-5f56-444f-a846-a96734e9ae12', 'volume_name': 'volume-87b39042-5f56-444f-a846-a96734e9ae12', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dff8b2-d9a4-4e99-8719-0404d57ccfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dff8b2-d9a4-4e99-8719-0404d57ccfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391abdf8-63de-4018-bb01-da7b0e0d4957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:52 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Volume 87b39042-5f56-444f-a846-a96734e9ae12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b39042-5f56-444f-a846-a96734e9ae12', 'volume_size': 1} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1182051500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b39042-5f56-444f-a846-a96734e9ae12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9f9dd18b31488895455171bc78703b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:33:52Z,use_quota=True,user_id='cc38e89d5e024c87b7229bb2d4d0b778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Creating volume 87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:33:52 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:33:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:52 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 1073741824 Jul 15 18:33:52 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:53 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 1073741824" returned: 0 in 1.367s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:53 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 Jul 15 18:33:53 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:54 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12" returned: 0 in 0.429s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:33:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391abdf8-63de-4018-bb01-da7b0e0d4957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b39042-5f56-444f-a846-a96734e9ae12', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719f7d75-9a30-4c32-a264-b27320c53221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:33:54 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Volume volume-87b39042-5f56-444f-a846-a96734e9ae12 (87b39042-5f56-444f-a846-a96734e9ae12): created successfully Jul 15 18:33:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719f7d75-9a30-4c32-a264-b27320c53221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:33:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Flow 'volume_create_manager' (ed9fdff8-df22-401f-8b22-27f3a31fae2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:33:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-2714dcd1-0099-4a41-b389-b8b1ae7abc70 tempest-SnapshotsActionsTest-1343460614 None] Created volume successfully. Jul 15 18:33:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] Creating offline snapshot 7915421c-99fb-49b1-8215-21ea5178753c of volume 87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:33:54 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[909bbfe7-4621-4ed5-b23e-cf615d8c3281]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:55 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 Jul 15 18:33:55 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:55 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12" returned: 0 in 0.461s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:55 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c 1G Jul 15 18:33:55 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:55 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c 1G" returned: 0 in 0.617s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:55 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:33:55 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:56 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.336s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:56 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c is being set with open permissions: ugo+rw Jul 15 18:33:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:56 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:33:56 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:56 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.280s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:56 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.info Jul 15 18:33:56 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:56 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.info" returned: 0 in 0.291s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:56 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.info is being set with open permissions: ugo+rw Jul 15 18:33:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:56 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.info Jul 15 18:33:56 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:57 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.info" returned: 0 in 0.274s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:33:57 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d4fb5f69-584b-498a-8551-df4371aa7371 tempest-SnapshotsActionsTest-1343460614 None] Create snapshot completed successfully Jul 15 18:33:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:33:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:33:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] Creating offline snapshot ef9bdacf-a403-49bd-ba97-afe75df595a1 of volume 87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:33:58 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b27c2d-efd5-45bb-969d-53761fbcfab6]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:33:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:58 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:33:58 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:59 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.404s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:33:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:59 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 1G Jul 15 18:33:59 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:59 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 1G" returned: 0 in 0.558s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:59 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 Jul 15 18:33:59 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:33:59 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Jul 15 18:33:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1" returned: 0 in 0.334s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:33:59 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 is being set with open permissions: ugo+rw Jul 15 18:33:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:33:59 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 Jul 15 18:33:59 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:00 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1" returned: 0 in 0.270s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.673s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:00 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f4aa6cce-838c-4399-ad3e-274539754f68 tempest-SnapshotsActionsTest-1343460614 None] Create snapshot completed successfully Jul 15 18:34:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Acquiring lock "cinder-ef9bdacf-a403-49bd-ba97-afe75df595a1-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-ef9bdacf-a403-49bd-ba97-afe75df595a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Acquiring lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Acquiring lock "cinder-quobyte-ef9bdacf-a403-49bd-ba97-afe75df595a1" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-ef9bdacf-a403-49bd-ba97-afe75df595a1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Deleting offline snapshot ef9bdacf-a403-49bd-ba97-afe75df595a1 of volume 87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:34:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] snapshot_file for this snap is: volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:34:00 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4fe5be-7d6a-4b0d-940a-7c650e486c42]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:01 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 Jul 15 18:34:01 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:01 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1" returned: 0 in 0.455s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:01 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e28f478-722a-4408-9f24-e27cebb4b5d6]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:01 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:34:01 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:01 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.522s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:02 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 Jul 15 18:34:02 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:02 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1" returned: 0 in 0.505s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:02 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1 Jul 15 18:34:02 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:02 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.ef9bdacf-a403-49bd-ba97-afe75df595a1" returned: 0 in 0.362s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-ef9bdacf-a403-49bd-ba97-afe75df595a1" released by "_delete_snapshot" :: held 1.963s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" released by "delete_snapshot" :: held 1.999s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:02 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Created reservations ['f118f72e-d1c9-4a64-83e0-9cd461590fac', '7a8802b4-2742-4a36-8322-ca43eaf74f1f', '0e78a17f-2730-429a-8696-fe4ddf8209fe', '802c22d8-48fe-4c74-b2d8-e597eba85679'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Delete snapshot completed successfully. Jul 15 18:34:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9d76e505-e8d8-4e49-bfdd-011ab2f80199 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-ef9bdacf-a403-49bd-ba97-afe75df595a1-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:04 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] Creating offline snapshot f1b9bfaf-1214-4666-908e-298f6d76a8c0 of volume 87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:34:04 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af88ae-2cf0-4112-a0d5-88a8ec6e84dd]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:04 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:34:04 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Flow 'volume_create_manager' (ac877f6c-a130-45c1-8918-c3eb2e4c9096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dbcc94c-f801-4d5f-a819-f4df9a6dd248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dbcc94c-f801-4d5f-a819-f4df9a6dd248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-164954930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba8ba5a-7a30-4546-bb39-0855f378acd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af3a4f447b2430c9d2ed689f67833d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:05Z,use_quota=True,user_id='e941dca556034d69b1891205aa3e20b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75df23b4-fe71-4b9e-bc85-092e6ab414e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75df23b4-fe71-4b9e-bc85-092e6ab414e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80e5103-2f8d-4b94-aa0b-6c7d20167b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80e5103-2f8d-4b94-aa0b-6c7d20167b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba8ba5a-7a30-4546-bb39-0855f378acd3', 'volume_name': 'volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710a7a2a-1d33-4473-8215-783f7a0e7c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710a7a2a-1d33-4473-8215-783f7a0e7c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb17fb9-94ba-4c2d-9b54-c2685b0aecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:05 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Volume 6ba8ba5a-7a30-4546-bb39-0855f378acd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3', 'volume_size': 1} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:05 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.522s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:05 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 1G Jul 15 18:34:05 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:05 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 1G" returned: 0 in 0.528s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:05 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 Jul 15 18:34:05 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:06 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0" returned: 0 in 0.338s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:06 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 is being set with open permissions: ugo+rw Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:06 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 Jul 15 18:34:06 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:06 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0" returned: 0 in 0.270s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.264s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-164954930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba8ba5a-7a30-4546-bb39-0855f378acd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af3a4f447b2430c9d2ed689f67833d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:05Z,use_quota=True,user_id='e941dca556034d69b1891205aa3e20b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Creating volume 6ba8ba5a-7a30-4546-bb39-0855f378acd3 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:34:06 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:06 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3 1073741824 Jul 15 18:34:06 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:06 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-27c1a034-a073-446d-90ab-fea5b295d6fa tempest-SnapshotsActionsTest-1343460614 None] Create snapshot completed successfully Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Acquiring lock "cinder-f1b9bfaf-1214-4666-908e-298f6d76a8c0-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-f1b9bfaf-1214-4666-908e-298f6d76a8c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Acquiring lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Acquiring lock "cinder-quobyte-f1b9bfaf-1214-4666-908e-298f6d76a8c0" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-f1b9bfaf-1214-4666-908e-298f6d76a8c0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Deleting offline snapshot f1b9bfaf-1214-4666-908e-298f6d76a8c0 of volume 87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] snapshot_file for this snap is: volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de3c37d-31e3-452b-af6c-3f828b485051]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:07 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3 1073741824" returned: 0 in 0.681s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:07 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3 Jul 15 18:34:07 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:07 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 Jul 15 18:34:07 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:07 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3" returned: 0 in 0.313s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb17fb9-94ba-4c2d-9b54-c2685b0aecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f76d751-841b-47b3-8a32-d02fb6a796a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:07 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Volume volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3 (6ba8ba5a-7a30-4546-bb39-0855f378acd3): created successfully Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f76d751-841b-47b3-8a32-d02fb6a796a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Flow 'volume_create_manager' (ac877f6c-a130-45c1-8918-c3eb2e4c9096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:07 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b29bdca5-1db6-4068-ab82-e9b67b8c9ec1 tempest-AttachVolumeShelveTestJSON-949054248 None] Created volume successfully. Jul 15 18:34:07 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0" returned: 0 in 0.611s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d453d2-0ad4-4a58-84ef-4c6713fc128b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:07 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:34:07 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:08 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.430s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:08 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 Jul 15 18:34:08 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:08 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0" returned: 0 in 0.472s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:08 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0 Jul 15 18:34:08 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:08 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.f1b9bfaf-1214-4666-908e-298f6d76a8c0" returned: 0 in 0.288s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-f1b9bfaf-1214-4666-908e-298f6d76a8c0" released by "_delete_snapshot" :: held 1.942s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" released by "delete_snapshot" :: held 1.975s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:09 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Created reservations ['944dbf18-e67e-4703-826f-936ad374be5b', 'd2d67558-4e83-4b34-9c81-33f550997c1e', '83105382-f5d9-4e77-82fc-c8449cbcc1d9', 'f39276b0-e728-41ad-97d4-04bdb69afe3a'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:09 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Delete snapshot completed successfully. Jul 15 18:34:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484a2fb-a68c-466f-99a7-b006bc0725f2 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-f1b9bfaf-1214-4666-908e-298f6d76a8c0-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] Creating offline snapshot cad2639a-3d6a-474e-bfab-d27b073fd5b2 of volume 87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:34:10 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f544036-5655-4d02-b349-7f39bf0a7657]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:10 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:34:10 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:11 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.425s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:11 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 1G Jul 15 18:34:11 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:11 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 1G" returned: 0 in 0.656s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:11 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 Jul 15 18:34:11 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:12 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2" returned: 0 in 0.356s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:12 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 is being set with open permissions: ugo+rw Jul 15 18:34:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:12 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 Jul 15 18:34:12 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:12 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2" returned: 0 in 0.361s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.936s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:12 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-55136631-443d-482e-a945-9e1dd87b6d7f tempest-SnapshotsActionsTest-1343460614 None] Create snapshot completed successfully Jul 15 18:34:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Acquiring lock "cinder-cad2639a-3d6a-474e-bfab-d27b073fd5b2-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-cad2639a-3d6a-474e-bfab-d27b073fd5b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Acquiring lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Acquiring lock "cinder-quobyte-cad2639a-3d6a-474e-bfab-d27b073fd5b2" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-cad2639a-3d6a-474e-bfab-d27b073fd5b2" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Deleting offline snapshot cad2639a-3d6a-474e-bfab-d27b073fd5b2 of volume 87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:34:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] snapshot_file for this snap is: volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:34:13 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[22305e87-2429-46c5-880d-abe265247c3c]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:13 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 Jul 15 18:34:13 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:13 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2" returned: 0 in 0.527s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:13 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d1b7a7-b353-4307-abf9-827803d1984b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:13 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:34:13 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:14 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.829s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:14 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 Jul 15 18:34:14 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:15 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2" returned: 0 in 0.500s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:15 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2 Jul 15 18:34:15 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:15 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.cad2639a-3d6a-474e-bfab-d27b073fd5b2" returned: 0 in 0.337s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-cad2639a-3d6a-474e-bfab-d27b073fd5b2" released by "_delete_snapshot" :: held 2.371s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" released by "delete_snapshot" :: held 2.410s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:15 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Created reservations ['995006d1-9171-44b0-afe0-85f76cc54b1e', '0f328a20-cff7-40bf-881e-9c9cd4c1d0ce', '51b5cd5c-dd88-453b-b7fb-996e3278a05c', '4ac76e7d-0c94-4b04-a97f-7055ac77b0d8'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:15 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Delete snapshot completed successfully. Jul 15 18:34:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e2cd97fd-f49a-4b61-aa0e-e290b9ec7a28 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-cad2639a-3d6a-474e-bfab-d27b073fd5b2-delete_snapshot" released by "delete_snapshot" :: held 2.638s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:16 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-93ce41ae-76ce-4b5d-9748-55227f83b392 req-2cb47d27-38a2-41ea-ad54-16029ae0703d tempest-AttachVolumeTestJSON-479770664 None] Terminate volume connection completed successfully. Jul 15 18:34:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-93ce41ae-76ce-4b5d-9748-55227f83b392 req-2cb47d27-38a2-41ea-ad54-16029ae0703d tempest-AttachVolumeTestJSON-479770664 None] Deleting attachment fb9054ca-0317-4c70-ba8e-5200e7d423f0. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:34:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] Creating offline snapshot 04570637-de37-4a83-bc0e-307563e856e3 of volume 87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:34:16 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a336ff0-05bb-42c6-b306-7c10e1d0edd6]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:16 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:34:16 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:17 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.507s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:17 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 1G Jul 15 18:34:17 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:17 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 1G" returned: 0 in 0.771s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:17 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 Jul 15 18:34:17 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:18 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3" returned: 0 in 0.451s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:18 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 is being set with open permissions: ugo+rw Jul 15 18:34:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:18 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 Jul 15 18:34:18 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:18 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3" returned: 0 in 0.285s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:18 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ea9aaad6-9aaa-449f-b849-46720115379a tempest-SnapshotsActionsTest-1343460614 None] Create snapshot completed successfully Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Flow 'volume_create_manager' (0233ca49-ec3f-4c4e-92d9-d09406d4d219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dd25ce-2837-47a8-b75f-5b7abfd38671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dd25ce-2837-47a8-b75f-5b7abfd38671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-889158951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb5efdf-52b4-4b66-8e54-9bafffab216e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b1ee14ce045abafb9e233af33bda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:19Z,use_quota=True,user_id='09c241588aec40fb9f9694071923fea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ab7608-be19-4875-acec-0502085b9c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ab7608-be19-4875-acec-0502085b9c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86fbcee6-f657-4b9a-b004-33a4a9478324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86fbcee6-f657-4b9a-b004-33a4a9478324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb5efdf-52b4-4b66-8e54-9bafffab216e', 'volume_name': 'volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd8c3a5-9c15-4d76-af27-f6e1bc7114ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd8c3a5-9c15-4d76-af27-f6e1bc7114ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eccc4ca-f360-4c92-866f-454d07922eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:19 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Volume eeb5efdf-52b4-4b66-8e54-9bafffab216e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e', 'volume_size': 1} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-889158951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb5efdf-52b4-4b66-8e54-9bafffab216e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b1ee14ce045abafb9e233af33bda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:34:19Z,use_quota=True,user_id='09c241588aec40fb9f9694071923fea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Creating volume eeb5efdf-52b4-4b66-8e54-9bafffab216e {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:34:19 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:19 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e 1073741824 Jul 15 18:34:19 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:19 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Acquiring lock "cinder-04570637-de37-4a83-bc0e-307563e856e3-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:20 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e 1073741824" returned: 0 in 0.622s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-04570637-de37-4a83-bc0e-307563e856e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Acquiring lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Acquiring lock "cinder-quobyte-04570637-de37-4a83-bc0e-307563e856e3" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-04570637-de37-4a83-bc0e-307563e856e3" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Deleting offline snapshot 04570637-de37-4a83-bc0e-307563e856e3 of volume 87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:34:20 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e Jul 15 18:34:20 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] snapshot_file for this snap is: volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e1fe9b-abf4-4990-a79a-7825add90ca5]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:20 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 Jul 15 18:34:20 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:20 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e" returned: 0 in 0.341s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eccc4ca-f360-4c92-866f-454d07922eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9561a93f-0eb3-4f49-bfbf-d0e6564e5ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:34:20 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Volume volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e (eeb5efdf-52b4-4b66-8e54-9bafffab216e): created successfully Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9561a93f-0eb3-4f49-bfbf-d0e6564e5ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Flow 'volume_create_manager' (0233ca49-ec3f-4c4e-92d9-d09406d4d219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:34:20 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-27e174bd-ab54-4a17-a06f-bfde1b8c379f tempest-VolumesActionsTest-704226098 None] Created volume successfully. Jul 15 18:34:20 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3" returned: 0 in 0.438s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[037087ff-c5e5-4fda-bcaf-bee441cf4de6]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-fbc2584a-f9b6-429e-bc79-e5f43cd0578c req-070dd168-df6a-49c5-923c-4ee3fb85e8ab tempest-AttachVolumeShelveTestJSON-949054248 None] No connector for attachment 93c1843c-bddc-47ca-ab89-c721a85cab24; skipping storage backend terminate_connection call. {{(pid=87217) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 15 18:34:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-fbc2584a-f9b6-429e-bc79-e5f43cd0578c req-070dd168-df6a-49c5-923c-4ee3fb85e8ab tempest-AttachVolumeShelveTestJSON-949054248 None] Deleting attachment 93c1843c-bddc-47ca-ab89-c721a85cab24. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:34:20 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:34:20 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:21 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.497s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:21 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 Jul 15 18:34:21 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:21 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3" returned: 0 in 0.625s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:21 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3 Jul 15 18:34:21 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:22 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.04570637-de37-4a83-bc0e-307563e856e3" returned: 0 in 0.493s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-04570637-de37-4a83-bc0e-307563e856e3" released by "_delete_snapshot" :: held 2.230s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" released by "delete_snapshot" :: held 2.275s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:22 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Created reservations ['a03c63fa-f98e-4a8e-ae01-d15f431324a6', '15ce4fb6-f8d3-43e6-b458-ec29a16a49e6', 'fa8a4374-9a3c-46e6-9960-dcfa859f3a5b', '3f469eb9-2c34-4afd-b270-da3300b437fb'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:22 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Delete snapshot completed successfully. Jul 15 18:34:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-55931406-644b-492b-85b3-2dcc04f61a05 tempest-SnapshotsActionsTest-589206878 None] Lock "cinder-04570637-de37-4a83-bc0e-307563e856e3-delete_snapshot" released by "delete_snapshot" :: held 2.547s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "cinder-7915421c-99fb-49b1-8215-21ea5178753c-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Lock "cinder-7915421c-99fb-49b1-8215-21ea5178753c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "cinder-quobyte-7915421c-99fb-49b1-8215-21ea5178753c" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Lock "cinder-quobyte-7915421c-99fb-49b1-8215-21ea5178753c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Deleting offline snapshot 7915421c-99fb-49b1-8215-21ea5178753c of volume 87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:34:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] snapshot_file for this snap is: volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:34:24 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[440e4235-e85d-4ec5-8c3b-53131cf7176e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:24 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:34:24 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:25 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.701s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b39042-5f56-444f-a846-a96734e9ae12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:34:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad4bd39-e9b9-4d3e-8648-a7b9ca5369a8]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:25 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 Jul 15 18:34:25 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:26 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12" returned: 0 in 0.866s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:26 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:34:26 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:26 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.609s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:26 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c Jul 15 18:34:26 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:27 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12.7915421c-99fb-49b1-8215-21ea5178753c" returned: 0 in 0.349s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Lock "cinder-quobyte-7915421c-99fb-49b1-8215-21ea5178753c" released by "_delete_snapshot" :: held 2.758s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" released by "delete_snapshot" :: held 2.797s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:27 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Created reservations ['29f3b589-9219-4bd2-9cbe-3d9e4d7bb0b8', 'adac7622-9203-40e7-9564-5ab888e0b8e6', 'be5ed4e3-7f8e-4fb6-a620-ffea101eb410', 'dfff7a00-981c-434e-9639-0108d4600ac0'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:27 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Delete snapshot completed successfully. Jul 15 18:34:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b319726f-b3f1-4da9-b3b2-14e1a07dfd2e tempest-SnapshotsActionsTest-1343460614 None] Lock "cinder-7915421c-99fb-49b1-8215-21ea5178753c-delete_snapshot" released by "delete_snapshot" :: held 3.057s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "cinder-87b39042-5f56-444f-a846-a96734e9ae12-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Lock "cinder-87b39042-5f56-444f-a846-a96734e9ae12-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:28 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d801525-8e26-4562-a99a-0c3ac48f4669]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:34:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:28 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 Jul 15 18:34:28 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:28 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12" returned: 0 in 0.473s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:28 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12 Jul 15 18:34:28 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:29 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-87b39042-5f56-444f-a846-a96734e9ae12" returned: 0 in 0.440s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Lock "cinder-quobyte-87b39042-5f56-444f-a846-a96734e9ae12" released by "delete_volume" :: held 1.009s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:29 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Created reservations ['84a926f4-a095-4601-9f73-980739bce1e5', 'e5ad9bf7-aa27-40ee-b12a-b07fb438f84c', '2620f367-5221-46f7-a967-372179d0dfc8', 'ca880f28-23c1-4b32-abfb-ace4b7166eba'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:34:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:29 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:34:29 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:29 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.320s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:29 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:34:29 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Deleted volume successfully. Jul 15 18:34:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4d451ecb-8bc2-4272-8247-7d47c878dc71 tempest-SnapshotsActionsTest-1343460614 None] Lock "cinder-87b39042-5f56-444f-a846-a96734e9ae12-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:34:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:34:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:34:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:34:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:34:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:34:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:34:32 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:34:32 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:34:33 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Jul 15 18:34:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.853s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:34:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:34:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:34:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 8 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:34:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:34:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8500669e-1661-408c-84dd-f2f4620e3250 tempest-VolumesActionsTest-704226098 None] Acquiring lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e" by "attach_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8500669e-1661-408c-84dd-f2f4620e3250 tempest-VolumesActionsTest-704226098 None] Lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e" acquired by "attach_volume" :: waited 0.114s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:37 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=88,cinder:SELECT=103,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:34:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8500669e-1661-408c-84dd-f2f4620e3250 tempest-VolumesActionsTest-704226098 None] Attaching volume eeb5efdf-52b4-4b66-8e54-9bafffab216e to instance 9569cd72-10fb-4312-b002-e151f0a39cb7 at mountpoint /dev/vdb on host None. Jul 15 18:34:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8500669e-1661-408c-84dd-f2f4620e3250 tempest-VolumesActionsTest-704226098 None] Attach volume completed successfully. Jul 15 18:34:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8500669e-1661-408c-84dd-f2f4620e3250 tempest-VolumesActionsTest-704226098 None] Lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e" released by "attach_volume" :: held 0.410s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-48748555-2f9d-4d8b-9994-b1a757a9125a tempest-VolumesActionsTest-704226098 None] Acquiring lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e-detach_volume" by "detach_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-48748555-2f9d-4d8b-9994-b1a757a9125a tempest-VolumesActionsTest-704226098 None] Lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-48748555-2f9d-4d8b-9994-b1a757a9125a tempest-VolumesActionsTest-704226098 None] Detaching volume eeb5efdf-52b4-4b66-8e54-9bafffab216e from instance 9569cd72-10fb-4312-b002-e151f0a39cb7. Jul 15 18:34:38 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-48748555-2f9d-4d8b-9994-b1a757a9125a tempest-VolumesActionsTest-704226098 None] Detach volume completed successfully. Jul 15 18:34:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-48748555-2f9d-4d8b-9994-b1a757a9125a tempest-VolumesActionsTest-704226098 None] Lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e-detach_volume" released by "detach_volume" :: held 0.223s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:48 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=56,cinder:INSERT=20,cinder:UPDATE=75,cinder:DELETE=5 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:34:48 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:34:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4b6e7a1e-8b60-4766-b4a7-22b7c334ce23 tempest-VolumesActionsTest-704226098 None] Acquiring lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e" by "attach_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4b6e7a1e-8b60-4766-b4a7-22b7c334ce23 tempest-VolumesActionsTest-704226098 None] Lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e" acquired by "attach_volume" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:57 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4b6e7a1e-8b60-4766-b4a7-22b7c334ce23 tempest-VolumesActionsTest-704226098 None] Attaching volume eeb5efdf-52b4-4b66-8e54-9bafffab216e to instance 2d939ff6-5b7e-4f87-83a5-c38a7290dc39 at mountpoint /dev/vdb on host None. Jul 15 18:34:57 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4b6e7a1e-8b60-4766-b4a7-22b7c334ce23 tempest-VolumesActionsTest-704226098 None] Attach volume completed successfully. Jul 15 18:34:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4b6e7a1e-8b60-4766-b4a7-22b7c334ce23 tempest-VolumesActionsTest-704226098 None] Lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e" released by "attach_volume" :: held 0.181s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:34:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9282168b-1c8f-4c31-b6c1-39f8b1f2c627 tempest-VolumesActionsTest-704226098 None] Acquiring lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e-detach_volume" by "detach_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:34:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9282168b-1c8f-4c31-b6c1-39f8b1f2c627 tempest-VolumesActionsTest-704226098 None] Lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:34:57 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9282168b-1c8f-4c31-b6c1-39f8b1f2c627 tempest-VolumesActionsTest-704226098 None] Detaching volume eeb5efdf-52b4-4b66-8e54-9bafffab216e from instance 2d939ff6-5b7e-4f87-83a5-c38a7290dc39. Jul 15 18:34:57 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9282168b-1c8f-4c31-b6c1-39f8b1f2c627 tempest-VolumesActionsTest-704226098 None] Detach volume completed successfully. Jul 15 18:34:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9282168b-1c8f-4c31-b6c1-39f8b1f2c627 tempest-VolumesActionsTest-704226098 None] Lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Flow 'volume_create_manager' (8e690c2f-9962-41f0-bb44-87dc5766ba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47f5767-4c41-437e-a29f-1183ac8281f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47f5767-4c41-437e-a29f-1183ac8281f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-870604377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1f1da2-8402-476d-bdde-07cf40fd9d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c345a2ed9e4f0a81b7fe9c50da2633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:02Z,use_quota=True,user_id='7db3ff6dbbb7451a9e479f77b5faf431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cdabe39-4d87-45f0-8979-50d6d633ea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cdabe39-4d87-45f0-8979-50d6d633ea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59e0b91-f1e9-48a7-9591-923a3683d424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59e0b91-f1e9-48a7-9591-923a3683d424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef1f1da2-8402-476d-bdde-07cf40fd9d4d', 'volume_name': 'volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e9cdf6-1166-488d-ae2e-8168a31a2295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e9cdf6-1166-488d-ae2e-8168a31a2295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5214caf-f4f6-40b3-92f8-7cf5f7c62618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:01 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Volume ef1f1da2-8402-476d-bdde-07cf40fd9d4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d', 'volume_size': 1} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-870604377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1f1da2-8402-476d-bdde-07cf40fd9d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c345a2ed9e4f0a81b7fe9c50da2633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:02Z,use_quota=True,user_id='7db3ff6dbbb7451a9e479f77b5faf431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Creating volume ef1f1da2-8402-476d-bdde-07cf40fd9d4d {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:01 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:35:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:01 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d 1073741824 Jul 15 18:35:01 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:02 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d 1073741824" returned: 0 in 0.754s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:02 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d Jul 15 18:35:02 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:03 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d" returned: 0 in 0.513s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5214caf-f4f6-40b3-92f8-7cf5f7c62618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6b81a3-f5d5-4d61-bf27-014efdcfebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:03 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Volume volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d (ef1f1da2-8402-476d-bdde-07cf40fd9d4d): created successfully Jul 15 18:35:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6b81a3-f5d5-4d61-bf27-014efdcfebb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Flow 'volume_create_manager' (8e690c2f-9962-41f0-bb44-87dc5766ba40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ca2c5d97-de56-4692-ac6d-32f08dd6fec6 tempest-VolumesServicesTestJSON-896045259 None] Created volume successfully. Jul 15 18:35:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Acquiring lock "cinder-ef1f1da2-8402-476d-bdde-07cf40fd9d4d-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Lock "cinder-ef1f1da2-8402-476d-bdde-07cf40fd9d4d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Acquiring lock "cinder-quobyte-ef1f1da2-8402-476d-bdde-07cf40fd9d4d" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Lock "cinder-quobyte-ef1f1da2-8402-476d-bdde-07cf40fd9d4d" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:04 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac11e3e-85df-4459-8d15-0d6728d2f49d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:04 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d Jul 15 18:35:04 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:04 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d" returned: 0 in 0.706s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:04 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d Jul 15 18:35:04 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d688e63-59ce-4803-81cc-213e71821371]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:05 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef1f1da2-8402-476d-bdde-07cf40fd9d4d" returned: 0 in 0.792s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Lock "cinder-quobyte-ef1f1da2-8402-476d-bdde-07cf40fd9d4d" released by "delete_volume" :: held 1.594s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:05 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e Jul 15 18:35:05 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Created reservations ['981273e5-8bfa-4646-b714-9391741e2aa3', 'ed3672f3-3e2e-4c0f-a901-62d12dac6674', 'aef315e0-39dd-4e1e-950c-cbf668a3e1bb', 'b062e61f-f955-4018-8139-ed245bb9bd51'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:06 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:35:06 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:06 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e" returned: 0 in 0.983s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:06 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[1879d13d-d52e-4839-99c5-f9529fa54fce]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:06 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.612s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:06 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:06 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Deleted volume successfully. Jul 15 18:35:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-afb7affd-e5a5-4bcc-b3e5-8ff83e6048f8 tempest-VolumesServicesTestJSON-896045259 None] Lock "cinder-ef1f1da2-8402-476d-bdde-07cf40fd9d4d-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:06 devstack sudo[94665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e Jul 15 18:35:06 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:07 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e" returned: 0 in 0.936s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.db2fa927-b6e2-4ae7-8547-07f0baa512a00k3xhim0.img {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:07 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.db2fa927-b6e2-4ae7-8547-07f0baa512a00k3xhim0.img Jul 15 18:35:07 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Acquiring lock "cinder-6ba8ba5a-7a30-4546-bb39-0855f378acd3-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Lock "cinder-6ba8ba5a-7a30-4546-bb39-0855f378acd3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Acquiring lock "cinder-quobyte-6ba8ba5a-7a30-4546-bb39-0855f378acd3" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Lock "cinder-quobyte-6ba8ba5a-7a30-4546-bb39-0855f378acd3" acquired by "delete_volume" :: waited 0.049s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:09 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[431f4d48-40ba-4fe1-b04a-7675f3e12f89]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:10 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3 Jul 15 18:35:10 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:11 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3" returned: 0 in 1.320s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:11 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3 Jul 15 18:35:11 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:11 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6ba8ba5a-7a30-4546-bb39-0855f378acd3" returned: 0 in 0.622s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Lock "cinder-quobyte-6ba8ba5a-7a30-4546-bb39-0855f378acd3" released by "delete_volume" :: held 2.090s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:11 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Created reservations ['3582b3ca-38b2-469e-baef-4419b3cee89b', '68246abb-1552-4c0b-8756-f0b2a88b77c7', '0bf85388-f7a3-42d3-8795-5c7343cd5e5e', '69d309ae-13f3-459e-b8c3-1545ef9b56af'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:12 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:35:12 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:13 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 1.341s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:13 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:13 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Deleted volume successfully. Jul 15 18:35:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fb14866e-8102-41ab-9496-c3026a5eba4a tempest-AttachVolumeShelveTestJSON-949054248 None] Lock "cinder-6ba8ba5a-7a30-4546-bb39-0855f378acd3-delete_volume" released by "delete_volume" :: held 4.239s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:14 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.db2fa927-b6e2-4ae7-8547-07f0baa512a00k3xhim0.img" returned: 0 in 7.571s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:14 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aa6009-c5f0-4c31-8cf4-cafc66d2f563]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:15 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e Jul 15 18:35:15 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:15 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e" returned: 0 in 0.729s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:15 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.db2fa927-b6e2-4ae7-8547-07f0baa512a00k3xhim0.img {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:35:15 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] Converted 1024.00 MB image at 135.24 MB/s Jul 15 18:35:15 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] db2fa927-b6e2-4ae7-8547-07f0baa512a0 was raw, no need to convert to raw {{(pid=87217) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 15 18:35:21 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Flow 'volume_create_manager' (1fbeeef8-d768-4d11-b4bf-fcc102fc742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bd8438-62e5-43da-8ca1-4daf1a2ba631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bd8438-62e5-43da-8ca1-4daf1a2ba631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1379962071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ffdb4c-6837-4d49-9214-05d1dd2063f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576282faaaf14d418c66c2561d8ddad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:21Z,use_quota=True,user_id='f0c27fe5c3a04d0a978e76c469823d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a38be21-c316-4e9d-bf58-278828cdf883),volume_type_id=5a38be21-c316-4e9d-bf58-278828cdf883)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cf8cbd-debc-4c18-919e-8644864b4587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cf8cbd-debc-4c18-919e-8644864b4587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da215c4e-aff0-4435-bf9d-0b0dfc45a5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da215c4e-aff0-4435-bf9d-0b0dfc45a5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ffdb4c-6837-4d49-9214-05d1dd2063f5', 'volume_name': 'volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6e1e16-0a83-4d32-8180-43931ebb57f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6e1e16-0a83-4d32-8180-43931ebb57f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e476618d-e7ad-40fc-a3a2-dda43beac35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:21 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Volume 29ffdb4c-6837-4d49-9214-05d1dd2063f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5', 'volume_size': 1} Jul 15 18:35:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:24 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Flow 'volume_create_manager' (0a91a5e4-2726-4428-a32d-4f6a033b83d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f035a6bb-0f02-4dc1-8e97-99a7f2bdb6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f035a6bb-0f02-4dc1-8e97-99a7f2bdb6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1454670457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14afbdf-22ad-42c7-b989-1e189ded86b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c25dd22d933449babbecbbe4c2e1e153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:24Z,use_quota=True,user_id='e71d638752b645799c1298e1b2cfe89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff42c37-754c-49e7-9765-50a02710ac8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff42c37-754c-49e7-9765-50a02710ac8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bc8d34-ee33-45a8-8472-123b1fdd8ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bc8d34-ee33-45a8-8472-123b1fdd8ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c14afbdf-22ad-42c7-b989-1e189ded86b6', 'volume_name': 'volume-c14afbdf-22ad-42c7-b989-1e189ded86b6', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c105a2ff-773b-4f46-8ea7-5f0a4f9c1c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c105a2ff-773b-4f46-8ea7-5f0a4f9c1c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f67966-adc7-4df1-a174-b326a0777610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:24 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Volume c14afbdf-22ad-42c7-b989-1e189ded86b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c14afbdf-22ad-42c7-b989-1e189ded86b6', 'volume_size': 1} Jul 15 18:35:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:35:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:32 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:35:32 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:32 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.266s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:35:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:35:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:35:34 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:INSERT=8,cinder:SELECT=17,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:35:34 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=28,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:35:35 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Flow 'volume_create_manager' (99fc1beb-19bd-4ac0-b526-0683bbdd62fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36cd730-c8ba-43e2-99ca-e7f9ebb74d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36cd730-c8ba-43e2-99ca-e7f9ebb74d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1066862084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d0f383-8907-4533-974a-539382a33205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e219988533374ca8bf85428b5726575b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:35Z,use_quota=True,user_id='9dda7e90bfaf435daf64eb19ad8742e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7fb1d3-568b-45f8-a323-d11681335507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7fb1d3-568b-45f8-a323-d11681335507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecfe763-045d-4a11-832c-cb96e48eded4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecfe763-045d-4a11-832c-cb96e48eded4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d0f383-8907-4533-974a-539382a33205', 'volume_name': 'volume-a3d0f383-8907-4533-974a-539382a33205', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f00f117-976b-42f2-9af6-c38c095f69b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f00f117-976b-42f2-9af6-c38c095f69b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47c6523-9c6b-4068-b8df-8f50725c0f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:35 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Volume a3d0f383-8907-4533-974a-539382a33205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d0f383-8907-4533-974a-539382a33205', 'volume_size': 1} Jul 15 18:35:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.569s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] Uploaded volume to glance image-id: db2fa927-b6e2-4ae7-8547-07f0baa512a0. {{(pid=87217) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 15 18:35:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.477s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1379962071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ffdb4c-6837-4d49-9214-05d1dd2063f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576282faaaf14d418c66c2561d8ddad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:21Z,use_quota=True,user_id='f0c27fe5c3a04d0a978e76c469823d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a38be21-c316-4e9d-bf58-278828cdf883),volume_type_id=5a38be21-c316-4e9d-bf58-278828cdf883)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Creating volume 29ffdb4c-6837-4d49-9214-05d1dd2063f5 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:37 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:35:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:37 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5 1073741824 Jul 15 18:35:37 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8c4f4b4e-ddd5-4ea1-a159-8c23f14c87fb tempest-VolumesActionsTest-704226098 None] Copy volume to image completed successfully. Jul 15 18:35:38 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5 1073741824" returned: 0 in 0.432s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:38 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5 Jul 15 18:35:38 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:38 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5" returned: 0 in 0.266s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.301s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1454670457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14afbdf-22ad-42c7-b989-1e189ded86b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c25dd22d933449babbecbbe4c2e1e153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:24Z,use_quota=True,user_id='e71d638752b645799c1298e1b2cfe89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Creating volume c14afbdf-22ad-42c7-b989-1e189ded86b6 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:38 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c14afbdf-22ad-42c7-b989-1e189ded86b6 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:38 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c14afbdf-22ad-42c7-b989-1e189ded86b6 1073741824 Jul 15 18:35:38 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e476618d-e7ad-40fc-a3a2-dda43beac35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fbaffe-d97f-419b-a1ca-efd9fae4d0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:38 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Volume volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5 (29ffdb4c-6837-4d49-9214-05d1dd2063f5): created successfully Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fbaffe-d97f-419b-a1ca-efd9fae4d0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Flow 'volume_create_manager' (1fbeeef8-d768-4d11-b4bf-fcc102fc742b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:38 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9baf6a02-4cb3-47c3-832a-3d2925b67020 tempest-VolumeTypesAccessTest-1389765762 None] Created volume successfully. Jul 15 18:35:39 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c14afbdf-22ad-42c7-b989-1e189ded86b6 1073741824" returned: 0 in 0.454s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c14afbdf-22ad-42c7-b989-1e189ded86b6 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:39 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c14afbdf-22ad-42c7-b989-1e189ded86b6 Jul 15 18:35:39 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:39 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c14afbdf-22ad-42c7-b989-1e189ded86b6" returned: 0 in 0.254s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1066862084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d0f383-8907-4533-974a-539382a33205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e219988533374ca8bf85428b5726575b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:35Z,use_quota=True,user_id='9dda7e90bfaf435daf64eb19ad8742e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Creating volume a3d0f383-8907-4533-974a-539382a33205 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:39 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:39 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205 1073741824 Jul 15 18:35:39 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f67966-adc7-4df1-a174-b326a0777610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c14afbdf-22ad-42c7-b989-1e189ded86b6', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a60249-622e-440b-89c4-ecc1beba9a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:39 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Volume volume-c14afbdf-22ad-42c7-b989-1e189ded86b6 (c14afbdf-22ad-42c7-b989-1e189ded86b6): created successfully Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a60249-622e-440b-89c4-ecc1beba9a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Flow 'volume_create_manager' (0a91a5e4-2726-4428-a32d-4f6a033b83d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:39 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a0d6bccc-0ee7-4cdc-a6c7-d38666c3ebe1 tempest-VolumesTestJSON-147784485 None] Created volume successfully. Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Acquiring lock "cinder-29ffdb4c-6837-4d49-9214-05d1dd2063f5-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Lock "cinder-29ffdb4c-6837-4d49-9214-05d1dd2063f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Acquiring lock "cinder-quobyte-29ffdb4c-6837-4d49-9214-05d1dd2063f5" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Lock "cinder-quobyte-29ffdb4c-6837-4d49-9214-05d1dd2063f5" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa87480-f5ce-4ccf-95dd-5f1b0a2da3e9]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:39 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5 Jul 15 18:35:39 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:39 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205 1073741824" returned: 0 in 0.510s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:39 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205 Jul 15 18:35:39 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:40 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5" returned: 0 in 0.434s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:40 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5 Jul 15 18:35:40 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:40 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205" returned: 0 in 0.303s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.811s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47c6523-9c6b-4068-b8df-8f50725c0f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d0f383-8907-4533-974a-539382a33205', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637a8579-7fd9-4203-aba1-1a6dd3a2c208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[844d9543-76a8-4689-8b58-d0098f7eb52b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:40 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Volume volume-a3d0f383-8907-4533-974a-539382a33205 (a3d0f383-8907-4533-974a-539382a33205): created successfully Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637a8579-7fd9-4203-aba1-1a6dd3a2c208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Flow 'volume_create_manager' (99fc1beb-19bd-4ac0-b526-0683bbdd62fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:40 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0542d280-6277-4846-918e-7bd7efd84904 tempest-AttachVolumeTestJSON-479770664 None] Created volume successfully. Jul 15 18:35:40 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e Jul 15 18:35:40 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:40 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-29ffdb4c-6837-4d49-9214-05d1dd2063f5" returned: 0 in 0.418s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Lock "cinder-quobyte-29ffdb4c-6837-4d49-9214-05d1dd2063f5" released by "delete_volume" :: held 0.902s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:40 devstack cinder-volume[87217]: WARNING cinder.quota [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2117277614 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2117277614, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:35:40 devstack cinder-volume[87217]: WARNING cinder.quota [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2117277614 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2117277614, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Created reservations ['df234f02-6367-4d48-96f4-9927fdca653b', '86b9d9d4-d4bd-4c14-aa1d-e0c202b1243e', 'b558f7d3-7e2c-479d-b5d0-30fa9152ea6a', '3c5a7eb8-8ec1-4636-b860-fee622ec5397'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:40 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:35:40 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:40 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e" returned: 0 in 0.633s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[be05c78f-15f6-4c6f-9e6a-51a26e3213c0]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Flow 'volume_create_manager' (b4901743-4daf-4f71-94ac-311ec21c082b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfd354d-ed87-4bdb-84d2-b4c710d048cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:41 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e Jul 15 18:35:41 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfd354d-ed87-4bdb-84d2-b4c710d048cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-343077167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8b24dd-1179-40e8-93aa-f6e99ab326b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c25dd22d933449babbecbbe4c2e1e153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:41Z,use_quota=True,user_id='e71d638752b645799c1298e1b2cfe89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b7b1c9-96f6-4fc2-bfe8-b48129a22ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b7b1c9-96f6-4fc2-bfe8-b48129a22ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb51d9d-5bcc-4391-89f3-2ad2fc06adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb51d9d-5bcc-4391-89f3-2ad2fc06adae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f8b24dd-1179-40e8-93aa-f6e99ab326b1', 'volume_name': 'volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed479c13-f1f0-4362-9178-fc37996905f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed479c13-f1f0-4362-9178-fc37996905f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fb2b40-89d0-44d8-a43a-e2d557a32c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:41 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Volume 5f8b24dd-1179-40e8-93aa-f6e99ab326b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1', 'volume_size': 1} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:41 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.399s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:41 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Deleted volume successfully. Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e0ceb6fa-3171-43f9-b6d1-dcdf150682f9 tempest-VolumeTypesAccessTest-1389765762 None] Lock "cinder-29ffdb4c-6837-4d49-9214-05d1dd2063f5-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:41 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e" returned: 0 in 0.611s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:41 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img Jul 15 18:35:41 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-813c47fe-b4db-42ad-b920-730c9c903604 req-0393934c-ae5a-40ab-9593-82f0526d6c20 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:46 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img" returned: 0 in 4.959s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:46 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[84891d3c-34e2-4b61-83f1-1cb8550cae9f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:46 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e Jul 15 18:35:46 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:47 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e" returned: 0 in 0.598s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:47 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:35:47 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Converted 1024.00 MB image at 206.44 MB/s Jul 15 18:35:47 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] 8121ccf0-aa1c-44ca-a31a-e1a24be028ea was raw, converting to qcow2 {{(pid=87217) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 15 18:35:47 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e190914a-ac3d-4744-aa70-a6f650899276]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:47 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img Jul 15 18:35:47 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:47 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img" returned: 0 in 0.390s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:47 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img Jul 15 18:35:47 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:47 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img" returned: 1 in 0.381s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:35:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img /opt/stack/data/cinder/conversion/vol_upload_a8k5808i {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:47 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img /opt/stack/data/cinder/conversion/vol_upload_a8k5808i Jul 15 18:35:47 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:48 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img /opt/stack/data/cinder/conversion/vol_upload_a8k5808i" returned: 0 in 0.305s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:48 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Image conversion details: src /opt/stack/data/cinder/conversion/eeb5efdf-52b4-4b66-8e54-9bafffab216e.temp_image.8121ccf0-aa1c-44ca-a31a-e1a24be028eayt39hltv.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_a8k5808i {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:35:48 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 15 18:35:48 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf80f3e7-35c0-41f8-b604-5f4c4322069a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a8k5808i {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:48 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a8k5808i Jul 15 18:35:48 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:48 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a8k5808i" returned: 0 in 0.391s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.498s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Uploaded volume to glance image-id: 8121ccf0-aa1c-44ca-a31a-e1a24be028ea. {{(pid=87217) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 15 18:35:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.528s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-343077167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8b24dd-1179-40e8-93aa-f6e99ab326b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c25dd22d933449babbecbbe4c2e1e153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:41Z,use_quota=True,user_id='e71d638752b645799c1298e1b2cfe89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Creating volume 5f8b24dd-1179-40e8-93aa-f6e99ab326b1 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:50 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:35:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:50 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c0247b77-25ed-410d-9827-c45c66d5df3f tempest-VolumesActionsTest-704226098 None] Copy volume to image completed successfully. Jul 15 18:35:50 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1 1073741824 Jul 15 18:35:50 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:51 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1 1073741824" returned: 0 in 0.578s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:51 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1 Jul 15 18:35:51 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:51 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1" returned: 0 in 0.262s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-813c47fe-b4db-42ad-b920-730c9c903604 req-0393934c-ae5a-40ab-9593-82f0526d6c20 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.919s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fb2b40-89d0-44d8-a43a-e2d557a32c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083a3936-e2ff-46f9-891c-856a1576dd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[788aa175-9f3c-4fcf-a6a5-47d1bdb38398]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-813c47fe-b4db-42ad-b920-730c9c903604 req-0393934c-ae5a-40ab-9593-82f0526d6c20 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:51 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Volume volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1 (5f8b24dd-1179-40e8-93aa-f6e99ab326b1): created successfully Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083a3936-e2ff-46f9-891c-856a1576dd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Flow 'volume_create_manager' (b4901743-4daf-4f71-94ac-311ec21c082b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:51 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d0fd95dc-6432-4805-a539-74921a3d189a tempest-VolumesTestJSON-147784485 None] Created volume successfully. Jul 15 18:35:51 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205 Jul 15 18:35:51 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Acquiring lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Acquiring lock "cinder-quobyte-eeb5efdf-52b4-4b66-8e54-9bafffab216e" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Lock "cinder-quobyte-eeb5efdf-52b4-4b66-8e54-9bafffab216e" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:52 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce12bf66-6c6d-4a05-8329-99bd526573b3]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:52 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e Jul 15 18:35:52 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:52 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-813c47fe-b4db-42ad-b920-730c9c903604 req-0393934c-ae5a-40ab-9593-82f0526d6c20 tempest-AttachVolumeTestJSON-479770664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205" returned: 0 in 0.504s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-813c47fe-b4db-42ad-b920-730c9c903604 req-0393934c-ae5a-40ab-9593-82f0526d6c20 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.552s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-813c47fe-b4db-42ad-b920-730c9c903604 req-0393934c-ae5a-40ab-9593-82f0526d6c20 tempest-AttachVolumeTestJSON-479770664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-a3d0f383-8907-4533-974a-539382a33205', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c46ff0b-d58b-4a0d-84fc-bfb88f1a6b65', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:35:52 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-813c47fe-b4db-42ad-b920-730c9c903604 req-0393934c-ae5a-40ab-9593-82f0526d6c20 tempest-AttachVolumeTestJSON-479770664 None] attachment_update completed successfully. Jul 15 18:35:52 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e" returned: 0 in 0.524s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:52 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e Jul 15 18:35:52 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:52 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eeb5efdf-52b4-4b66-8e54-9bafffab216e" returned: 0 in 0.371s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Lock "cinder-quobyte-eeb5efdf-52b4-4b66-8e54-9bafffab216e" released by "delete_volume" :: held 0.948s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Created reservations ['7959122e-8115-46a1-a75a-693e2e3bda47', '7d6f937d-7ef2-4c77-b6a3-de0c1fd94c8e', 'f0562389-2a63-4520-af7d-ce5e588d4eb4', '5a867dd5-f0bc-49f0-b60d-816cbf28bf91'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:53 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:35:53 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Flow 'volume_create_manager' (a5bf8d39-c2c6-4e79-a5f3-5162886f7611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6af3a3-cdde-4f0d-b4b5-0afffad396ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6af3a3-cdde-4f0d-b4b5-0afffad396ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1637266069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d923eceb-3c8f-4b9f-8d8c-7e0ceb742660,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c25dd22d933449babbecbbe4c2e1e153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:53Z,use_quota=True,user_id='e71d638752b645799c1298e1b2cfe89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d6f462-3137-4578-bc67-12debab460a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d6f462-3137-4578-bc67-12debab460a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302ac86d-17af-4ca1-ae00-6897167c37bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302ac86d-17af-4ca1-ae00-6897167c37bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd923eceb-3c8f-4b9f-8d8c-7e0ceb742660', 'volume_name': 'volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886dcdb1-4c22-4c36-804d-3aac2554e7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886dcdb1-4c22-4c36-804d-3aac2554e7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc77f795-e824-4702-88b4-56c2aee180bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:53 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Volume d923eceb-3c8f-4b9f-8d8c-7e0ceb742660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660', 'volume_size': 1} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1637266069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d923eceb-3c8f-4b9f-8d8c-7e0ceb742660,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c25dd22d933449babbecbbe4c2e1e153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:53Z,use_quota=True,user_id='e71d638752b645799c1298e1b2cfe89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Creating volume d923eceb-3c8f-4b9f-8d8c-7e0ceb742660 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:53 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:53 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660 1073741824 Jul 15 18:35:53 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:53 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.321s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:53 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Deleted volume successfully. Jul 15 18:35:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5bf1c271-77a4-4358-8512-01d8d59e9b87 tempest-VolumesActionsTest-704226098 None] Lock "cinder-eeb5efdf-52b4-4b66-8e54-9bafffab216e-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:54 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660 1073741824" returned: 0 in 0.553s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:54 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660 Jul 15 18:35:54 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:54 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660" returned: 0 in 0.306s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc77f795-e824-4702-88b4-56c2aee180bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2225e97f-dbbc-41f0-ba5e-c3136b3b6ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:54 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Volume volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660 (d923eceb-3c8f-4b9f-8d8c-7e0ceb742660): created successfully Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2225e97f-dbbc-41f0-ba5e-c3136b3b6ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Flow 'volume_create_manager' (a5bf8d39-c2c6-4e79-a5f3-5162886f7611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-5ef8f3ec-e8b9-41d6-8673-43564abb81c9 tempest-VolumesTestJSON-147784485 None] Created volume successfully. Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Flow 'volume_create_manager' (641e2b8a-0d14-4cdc-8598-19d767f5486e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6d29f8-51ea-45c7-9691-5e518f9b6a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6d29f8-51ea-45c7-9691-5e518f9b6a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-279606825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef789bee-187f-4c6e-8b30-810ea29f294a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e219988533374ca8bf85428b5726575b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:55Z,use_quota=True,user_id='9dda7e90bfaf435daf64eb19ad8742e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c227f46c-fe8c-40c3-94c0-edc36f266c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c227f46c-fe8c-40c3-94c0-edc36f266c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9a53dc-1835-490b-a4f1-ce3d776462a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9a53dc-1835-490b-a4f1-ce3d776462a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef789bee-187f-4c6e-8b30-810ea29f294a', 'volume_name': 'volume-ef789bee-187f-4c6e-8b30-810ea29f294a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ed0dae-e64a-4973-af44-e85618183eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ed0dae-e64a-4973-af44-e85618183eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc34381-7f0a-442d-b1a5-960cc075803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:54 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Volume ef789bee-187f-4c6e-8b30-810ea29f294a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef789bee-187f-4c6e-8b30-810ea29f294a', 'volume_size': 1} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-279606825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef789bee-187f-4c6e-8b30-810ea29f294a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e219988533374ca8bf85428b5726575b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:35:55Z,use_quota=True,user_id='9dda7e90bfaf435daf64eb19ad8742e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Creating volume ef789bee-187f-4c6e-8b30-810ea29f294a {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:35:54 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:35:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:54 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a 1073741824 Jul 15 18:35:54 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:55 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a 1073741824" returned: 0 in 0.706s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:55 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a Jul 15 18:35:55 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:56 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a" returned: 0 in 0.431s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc34381-7f0a-442d-b1a5-960cc075803e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef789bee-187f-4c6e-8b30-810ea29f294a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d31b14-27fc-4a6e-aa74-ad40ae8957c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:35:56 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Volume volume-ef789bee-187f-4c6e-8b30-810ea29f294a (ef789bee-187f-4c6e-8b30-810ea29f294a): created successfully Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d31b14-27fc-4a6e-aa74-ad40ae8957c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Flow 'volume_create_manager' (641e2b8a-0d14-4cdc-8598-19d767f5486e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:35:56 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-3f31125b-ddbf-4c3c-828c-b32290eb5542 tempest-AttachVolumeTestJSON-479770664 None] Created volume successfully. Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Acquiring lock "cinder-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Lock "cinder-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Acquiring lock "cinder-quobyte-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Lock "cinder-quobyte-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbbd372-4a31-4492-b982-fbab46d4c2fd]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:57 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660 Jul 15 18:35:57 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:57 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660" returned: 0 in 0.492s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:57 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660 Jul 15 18:35:57 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:57 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660" returned: 0 in 0.444s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Lock "cinder-quobyte-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660" released by "delete_volume" :: held 1.013s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:57 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Created reservations ['bf5e84c7-4cb0-4d38-a377-cc869003fe0a', 'cd858bcf-d69a-4582-91b0-c0f2eacac4a3', '4729dbdf-5964-4ae5-ab40-2dce82f697a2', 'e124cc50-b8c8-4b5d-bbda-f594a1010202'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-09653a2f-441e-4a89-a481-af277e57e476 req-20af2d2b-880a-47f5-a914-6759919c8820 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-09653a2f-441e-4a89-a481-af277e57e476 req-20af2d2b-880a-47f5-a914-6759919c8820 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1c42e6-c529-4339-b639-16f9fadeb366]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-09653a2f-441e-4a89-a481-af277e57e476 req-20af2d2b-880a-47f5-a914-6759919c8820 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:58 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:35:58 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:58 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a Jul 15 18:35:58 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:58 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.370s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:35:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Deleted volume successfully. Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8189a563-2e57-4357-94a1-914f0979aa7d tempest-VolumesTestJSON-147784485 None] Lock "cinder-d923eceb-3c8f-4b9f-8d8c-7e0ceb742660-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:35:58 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-09653a2f-441e-4a89-a481-af277e57e476 req-20af2d2b-880a-47f5-a914-6759919c8820 tempest-AttachVolumeTestJSON-479770664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a" returned: 0 in 0.593s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-09653a2f-441e-4a89-a481-af277e57e476 req-20af2d2b-880a-47f5-a914-6759919c8820 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.636s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:35:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-09653a2f-441e-4a89-a481-af277e57e476 req-20af2d2b-880a-47f5-a914-6759919c8820 tempest-AttachVolumeTestJSON-479770664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-ef789bee-187f-4c6e-8b30-810ea29f294a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e41c62a7-4653-46f6-adac-6eee590986fc', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:35:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-09653a2f-441e-4a89-a481-af277e57e476 req-20af2d2b-880a-47f5-a914-6759919c8820 tempest-AttachVolumeTestJSON-479770664 None] attachment_update completed successfully. Jul 15 18:35:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Acquiring lock "cinder-5f8b24dd-1179-40e8-93aa-f6e99ab326b1-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Lock "cinder-5f8b24dd-1179-40e8-93aa-f6e99ab326b1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Acquiring lock "cinder-quobyte-5f8b24dd-1179-40e8-93aa-f6e99ab326b1" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:35:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Lock "cinder-quobyte-5f8b24dd-1179-40e8-93aa-f6e99ab326b1" acquired by "delete_volume" :: waited 0.037s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:35:59 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce164881-49d2-4bf7-9327-fd50e3ed6c2d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:35:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:59 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1 Jul 15 18:35:59 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:35:59 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Jul 15 18:35:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1" returned: 0 in 0.465s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:35:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:35:59 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1 Jul 15 18:35:59 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:00 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5f8b24dd-1179-40e8-93aa-f6e99ab326b1" returned: 0 in 0.319s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Lock "cinder-quobyte-5f8b24dd-1179-40e8-93aa-f6e99ab326b1" released by "delete_volume" :: held 0.879s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Created reservations ['b6f6c612-d62a-4f64-8ee0-f2cb5dc6757d', '2087af48-c558-48b2-9e2f-53ea16828ad6', 'f21e7191-a23b-4270-96c1-e36db45b7e5f', '4bf66464-954b-4699-9c77-434c4798b1ff'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:00 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:00 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Acquiring lock "cinder-c14afbdf-22ad-42c7-b989-1e189ded86b6-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Lock "cinder-c14afbdf-22ad-42c7-b989-1e189ded86b6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Acquiring lock "cinder-quobyte-c14afbdf-22ad-42c7-b989-1e189ded86b6" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Lock "cinder-quobyte-c14afbdf-22ad-42c7-b989-1e189ded86b6" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[72948281-3dc5-40e2-9a4e-fab3ab3f3629]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c14afbdf-22ad-42c7-b989-1e189ded86b6 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:00 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.424s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:00 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Deleted volume successfully. Jul 15 18:36:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-89a4679d-5200-4df4-9aed-4b5e49be4a53 tempest-VolumesTestJSON-147784485 None] Lock "cinder-5f8b24dd-1179-40e8-93aa-f6e99ab326b1-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:00 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c14afbdf-22ad-42c7-b989-1e189ded86b6 Jul 15 18:36:00 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:01 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-5b6eb8c9-f944-4a6a-bf9f-8d867c3efd69 req-c1864db1-6877-4c80-abae-dc362661b268 tempest-AttachVolumeTestJSON-479770664 None] Terminate volume connection completed successfully. Jul 15 18:36:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-5b6eb8c9-f944-4a6a-bf9f-8d867c3efd69 req-c1864db1-6877-4c80-abae-dc362661b268 tempest-AttachVolumeTestJSON-479770664 None] Deleting attachment 2c46ff0b-d58b-4a0d-84fc-bfb88f1a6b65. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:36:01 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c14afbdf-22ad-42c7-b989-1e189ded86b6" returned: 0 in 0.595s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c14afbdf-22ad-42c7-b989-1e189ded86b6 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:01 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c14afbdf-22ad-42c7-b989-1e189ded86b6 Jul 15 18:36:01 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:01 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c14afbdf-22ad-42c7-b989-1e189ded86b6" returned: 0 in 0.389s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Lock "cinder-quobyte-c14afbdf-22ad-42c7-b989-1e189ded86b6" released by "delete_volume" :: held 1.069s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:01 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Created reservations ['78a0fc41-d68c-4855-b975-aae8a156a3a8', '6279faf0-6913-4b6e-bc49-76f9b56f1750', 'e1ddd297-a1e7-40ff-83f9-64fef88a9c10', 'ca17ef98-dde3-45cb-ad8d-3610eebdf0ae'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:01 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:01 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:02 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.282s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:02 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Deleted volume successfully. Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c4fa5a5a-2358-476f-828a-ab0328d938f9 tempest-VolumesTestJSON-147784485 None] Lock "cinder-c14afbdf-22ad-42c7-b989-1e189ded86b6-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Flow 'volume_create_manager' (aa9bca45-7f5b-48f2-939e-e36fc3dfa188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629ad280-5197-41c5-b7ed-c4a156ce388d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629ad280-5197-41c5-b7ed-c4a156ce388d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1386146711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2892618-fa2d-4ad3-9d07-ba7910c60843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc61dc0be3c476aa4307217d09f099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:03Z,use_quota=True,user_id='6df50006e159432eb1de6d4df5b98490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ca58b6-02c1-48d6-bafe-52cab78f8957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ca58b6-02c1-48d6-bafe-52cab78f8957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b268e0-21f2-494a-abaf-6a2b89e6480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b268e0-21f2-494a-abaf-6a2b89e6480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2892618-fa2d-4ad3-9d07-ba7910c60843', 'volume_name': 'volume-a2892618-fa2d-4ad3-9d07-ba7910c60843', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e1dfa3-7192-4694-80d5-923f54609030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e1dfa3-7192-4694-80d5-923f54609030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdec52b-1333-49b4-ad29-49ec3208c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:02 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Volume a2892618-fa2d-4ad3-9d07-ba7910c60843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2892618-fa2d-4ad3-9d07-ba7910c60843', 'volume_size': 1} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1386146711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2892618-fa2d-4ad3-9d07-ba7910c60843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc61dc0be3c476aa4307217d09f099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:03Z,use_quota=True,user_id='6df50006e159432eb1de6d4df5b98490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Creating volume a2892618-fa2d-4ad3-9d07-ba7910c60843 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:02 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:02 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 1073741824 Jul 15 18:36:02 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:02 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-a56bd47d-b858-4fff-a357-ff273ab88f36 req-819a2929-2039-4759-8fd2-137ddb1d58b4 tempest-AttachVolumeTestJSON-479770664 None] Terminate volume connection completed successfully. Jul 15 18:36:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-a56bd47d-b858-4fff-a357-ff273ab88f36 req-819a2929-2039-4759-8fd2-137ddb1d58b4 tempest-AttachVolumeTestJSON-479770664 None] Deleting attachment e41c62a7-4653-46f6-adac-6eee590986fc. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:36:03 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 1073741824" returned: 0 in 0.639s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:03 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 Jul 15 18:36:03 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:03 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843" returned: 0 in 0.337s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdec52b-1333-49b4-ad29-49ec3208c57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2892618-fa2d-4ad3-9d07-ba7910c60843', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040a8f0a-7053-4dfe-b79b-46b1c9303c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:03 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Volume volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 (a2892618-fa2d-4ad3-9d07-ba7910c60843): created successfully Jul 15 18:36:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040a8f0a-7053-4dfe-b79b-46b1c9303c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Flow 'volume_create_manager' (aa9bca45-7f5b-48f2-939e-e36fc3dfa188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b7798773-8178-4fb8-9468-50c81af260c9 tempest-VolumesCloneTest-346003604 None] Created volume successfully. Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Flow 'volume_create_manager' (560a6432-b9f7-438d-bcc7-93fa64d3064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb727f06-1227-4b8f-8bf1-a7032a6164cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb727f06-1227-4b8f-8bf1-a7032a6164cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1592321721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735507dd-b9cb-44f2-b1af-6696779cd505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc61dc0be3c476aa4307217d09f099d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a2892618-fa2d-4ad3-9d07-ba7910c60843,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:06Z,use_quota=True,user_id='6df50006e159432eb1de6d4df5b98490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1201c663-3067-4c6e-bf94-bb1ccd73977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1201c663-3067-4c6e-bf94-bb1ccd73977d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adcfa4c2-5e3f-40d5-a3a4-f7a685d17dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adcfa4c2-5e3f-40d5-a3a4-f7a685d17dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '735507dd-b9cb-44f2-b1af-6696779cd505', 'volume_name': 'volume-735507dd-b9cb-44f2-b1af-6696779cd505', 'volume_size': 2, 'source_volid': 'a2892618-fa2d-4ad3-9d07-ba7910c60843', 'source_volstatus': 'available'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb62ec3-956c-42d7-b4ba-342ae09e0384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb62ec3-956c-42d7-b4ba-342ae09e0384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec4d6ed-ee4f-4716-9944-0c28a1fafb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:05 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Volume 735507dd-b9cb-44f2-b1af-6696779cd505: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-735507dd-b9cb-44f2-b1af-6696779cd505', 'volume_size': 2, 'source_volid': 'a2892618-fa2d-4ad3-9d07-ba7910c60843', 'source_volstatus': 'available'} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:05 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Cloning volume a2892618-fa2d-4ad3-9d07-ba7910c60843 to volume 735507dd-b9cb-44f2-b1af-6696779cd505 Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Creating offline snapshot 52d5b5a1-0def-41f6-b3ee-845556e6247e of volume a2892618-fa2d-4ad3-9d07-ba7910c60843 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9772ba-c2c5-42ba-bd94-a2271cbdbfe3]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:06 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 Jul 15 18:36:06 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:06 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843" returned: 0 in 0.584s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:06 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e 1G Jul 15 18:36:06 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:07 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e 1G" returned: 0 in 0.619s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:07 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e Jul 15 18:36:07 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:07 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e" returned: 0 in 0.496s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:07 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e is being set with open permissions: ugo+rw Jul 15 18:36:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:07 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e Jul 15 18:36:07 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:07 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e" returned: 0 in 0.352s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:08 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.info Jul 15 18:36:08 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:08 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.info" returned: 0 in 0.321s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:08 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.info is being set with open permissions: ugo+rw Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:08 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.info Jul 15 18:36:08 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Flow 'volume_create_manager' (d0e6c87d-5d05-427b-8d9f-a133467cefce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f0eec7-6703-4b4a-873c-c72fbca0223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f0eec7-6703-4b4a-873c-c72fbca0223d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1299757295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e069c3e-be39-4722-8c3a-9fb4151e317f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360486e1072f402283bea74533aa1648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:08Z,use_quota=True,user_id='3d49efd4a53e4f8695b8d58dfb9d3e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed55fdc-2f2c-4f26-ab2c-adb573ba5951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed55fdc-2f2c-4f26-ab2c-adb573ba5951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7eda385-2ba5-4c87-8dad-84db77ce79f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7eda385-2ba5-4c87-8dad-84db77ce79f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e069c3e-be39-4722-8c3a-9fb4151e317f', 'volume_name': 'volume-0e069c3e-be39-4722-8c3a-9fb4151e317f', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ad0b90-c4e5-4840-b5cd-f12927092368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ad0b90-c4e5-4840-b5cd-f12927092368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e52b115-03f3-4493-844d-ab2cd18af1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:08 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Volume 0e069c3e-be39-4722-8c3a-9fb4151e317f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e069c3e-be39-4722-8c3a-9fb4151e317f', 'volume_size': 1} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:08 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.info" returned: 0 in 0.259s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Acquiring lock "cinder-quobyte-735507dd-b9cb-44f2-b1af-6696779cd505" by "_copy_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Lock "cinder-quobyte-735507dd-b9cb-44f2-b1af-6696779cd505" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] snapshot: 52d5b5a1-0def-41f6-b3ee-845556e6247e, volume: 735507dd-b9cb-44f2-b1af-6696779cd505, {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b02110-7542-4226-9bef-8615a67cd17f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:08 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e Jul 15 18:36:08 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:09 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e" returned: 0 in 0.405s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2892618-fa2d-4ad3-9d07-ba7910c60843(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:36:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:36:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Creating direct copy from snapshot {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:36:09 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe08cc1b-74fb-4dbe-912c-5daf534b5f96]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:09 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 Jul 15 18:36:09 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:09 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843" returned: 0 in 0.506s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:09 devstack cinder-volume[87217]: DEBUG cinder.utils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Path /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505 not found in is_blk_device check {{(pid=87217) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:36:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:09 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505 Jul 15 18:36:09 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "cinder-ef789bee-187f-4c6e-8b30-810ea29f294a-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Lock "cinder-ef789bee-187f-4c6e-8b30-810ea29f294a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "cinder-quobyte-ef789bee-187f-4c6e-8b30-810ea29f294a" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Lock "cinder-quobyte-ef789bee-187f-4c6e-8b30-810ea29f294a" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:10 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8332c4-5628-4fdf-b40b-087522aad102]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:10 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a Jul 15 18:36:10 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:10 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a" returned: 0 in 0.745s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:10 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a Jul 15 18:36:10 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:11 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ef789bee-187f-4c6e-8b30-810ea29f294a" returned: 0 in 0.776s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Lock "cinder-quobyte-ef789bee-187f-4c6e-8b30-810ea29f294a" released by "delete_volume" :: held 1.585s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:11 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Created reservations ['83aa21bf-ca67-4f50-bcd8-a26aa61ef940', 'afedc6d0-bf88-4c96-bed3-e498d7816b3a', '68997a57-0b19-4b4f-901b-258f0c50c76b', '7d890fca-2d17-49dd-9885-06e082e82174'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:12 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:12 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "cinder-a3d0f383-8907-4533-974a-539382a33205-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Lock "cinder-a3d0f383-8907-4533-974a-539382a33205-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:12 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.664s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "cinder-quobyte-a3d0f383-8907-4533-974a-539382a33205" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:12 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Deleted volume successfully. Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Lock "cinder-quobyte-a3d0f383-8907-4533-974a-539382a33205" acquired by "delete_volume" :: waited 0.056s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ce05c55c-ad5f-4e3c-ae55-d55821a400f0 tempest-AttachVolumeTestJSON-479770664 None] Lock "cinder-ef789bee-187f-4c6e-8b30-810ea29f294a-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[470b3ce0-b6e0-4d87-9beb-d846a47dca00]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:13 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205 Jul 15 18:36:13 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:13 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205" returned: 0 in 0.768s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:13 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205 Jul 15 18:36:13 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:14 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a3d0f383-8907-4533-974a-539382a33205" returned: 0 in 0.584s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Lock "cinder-quobyte-a3d0f383-8907-4533-974a-539382a33205" released by "delete_volume" :: held 1.450s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:14 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Created reservations ['feb422ab-c4ec-4a55-a0e1-3517e3c6b93b', 'cf9e73ba-05ef-4cad-a71d-604c007e56b0', '3aa6a14f-21d3-4a03-83bd-71f4db8def55', 'fcf63629-3e1a-45ee-82a7-b0163622bd97'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:14 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:14 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:15 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.459s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:15 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:15 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Deleted volume successfully. Jul 15 18:36:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bd58ac8e-1b0f-4592-8fee-135591862697 tempest-AttachVolumeTestJSON-479770664 None] Lock "cinder-a3d0f383-8907-4533-974a-539382a33205-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "cinder-269148e2-656d-45e3-9689-27417a550c37-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Lock "cinder-269148e2-656d-45e3-9689-27417a550c37-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:15 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505" returned: 0 in 6.037s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "cinder-quobyte-269148e2-656d-45e3-9689-27417a550c37" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:15 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[72572059-3b30-41d6-84b4-ff273bdb45f6]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Lock "cinder-quobyte-269148e2-656d-45e3-9689-27417a550c37" acquired by "delete_volume" :: waited 0.029s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:15 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[30200713-8fd7-4911-9d16-c1ec6150a2ca]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:15 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 Jul 15 18:36:15 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:15 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37 Jul 15 18:36:15 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:16 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37" returned: 0 in 0.418s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:16 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37 Jul 15 18:36:16 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:16 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843" returned: 0 in 0.628s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505 {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:36:16 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Converted 1024.00 MB image at 169.51 MB/s Jul 15 18:36:16 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505 is being set with open permissions: ugo+rw Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:16 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505 Jul 15 18:36:16 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:16 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-269148e2-656d-45e3-9689-27417a550c37" returned: 0 in 0.267s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Lock "cinder-quobyte-269148e2-656d-45e3-9689-27417a550c37" released by "delete_volume" :: held 0.740s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Created reservations ['aa2f37b0-11c1-4c76-b29f-fdea19268140', '114c4872-9632-480b-8a4e-9b3cc379a491', 'a054dd1e-afaf-4928-9afa-b1b0e9c9d07f', 'dc0969ed-9f4c-45d1-87b0-2610c1c4083e'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:16 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505" returned: 0 in 0.312s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Lock "cinder-quobyte-735507dd-b9cb-44f2-b1af-6696779cd505" released by "_copy_volume_from_snapshot" :: held 7.988s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:16 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:16 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Acquiring lock "cinder-quobyte-52d5b5a1-0def-41f6-b3ee-845556e6247e" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Lock "cinder-quobyte-52d5b5a1-0def-41f6-b3ee-845556e6247e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Deleting offline snapshot 52d5b5a1-0def-41f6-b3ee-845556e6247e of volume a2892618-fa2d-4ad3-9d07-ba7910c60843 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] snapshot_file for this snap is: volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[91663828-c3b5-4d16-a4b1-049387d52356]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:16 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e Jul 15 18:36:16 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:16 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.302s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:16 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Deleted volume successfully. Jul 15 18:36:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2300afa-913b-4a99-a239-19645fe2ca7e tempest-AttachVolumeTestJSON-479770664 None] Lock "cinder-269148e2-656d-45e3-9689-27417a550c37-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:17 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e" returned: 0 in 0.437s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2892618-fa2d-4ad3-9d07-ba7910c60843(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:36:17 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7eda4a1-0852-402e-9f29-8d4dba5c283e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:17 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 Jul 15 18:36:17 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:17 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843" returned: 0 in 0.403s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:17 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e Jul 15 18:36:17 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:18 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e" returned: 0 in 0.458s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:18 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e Jul 15 18:36:18 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:18 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843.52d5b5a1-0def-41f6-b3ee-845556e6247e" returned: 0 in 0.259s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Lock "cinder-quobyte-52d5b5a1-0def-41f6-b3ee-845556e6247e" released by "_delete_snapshot" :: held 1.702s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.594s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.908s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1299757295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e069c3e-be39-4722-8c3a-9fb4151e317f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360486e1072f402283bea74533aa1648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:08Z,use_quota=True,user_id='3d49efd4a53e4f8695b8d58dfb9d3e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Creating volume 0e069c3e-be39-4722-8c3a-9fb4151e317f {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:18 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec4d6ed-ee4f-4716-9944-0c28a1fafb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735507dd-b9cb-44f2-b1af-6696779cd505', 'volume_size': 2, 'source_volid': 'a2892618-fa2d-4ad3-9d07-ba7910c60843', 'source_volstatus': 'available'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:18 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f 1073741824 Jul 15 18:36:18 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe7780c-10c0-4efa-b1c4-1e8d343a3fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:18 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Volume volume-735507dd-b9cb-44f2-b1af-6696779cd505 (735507dd-b9cb-44f2-b1af-6696779cd505): created successfully Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe7780c-10c0-4efa-b1c4-1e8d343a3fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Flow 'volume_create_manager' (560a6432-b9f7-438d-bcc7-93fa64d3064b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:18 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a52a71a4-ebb3-482c-a6ce-807abc8193b1 tempest-VolumesCloneTest-346003604 None] Created volume successfully. Jul 15 18:36:19 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f 1073741824" returned: 0 in 0.612s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Acquiring lock "cinder-735507dd-b9cb-44f2-b1af-6696779cd505-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:19 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f Jul 15 18:36:19 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Lock "cinder-735507dd-b9cb-44f2-b1af-6696779cd505-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Acquiring lock "cinder-quobyte-735507dd-b9cb-44f2-b1af-6696779cd505" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Lock "cinder-quobyte-735507dd-b9cb-44f2-b1af-6696779cd505" acquired by "delete_volume" :: waited 0.027s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b8cfc6-005c-4937-8bdb-a05c7104ff61]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:19 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505 Jul 15 18:36:19 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:19 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f" returned: 0 in 0.354s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e52b115-03f3-4493-844d-ab2cd18af1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e069c3e-be39-4722-8c3a-9fb4151e317f', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48b5939-e481-412a-8158-365bdf870376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:19 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Volume volume-0e069c3e-be39-4722-8c3a-9fb4151e317f (0e069c3e-be39-4722-8c3a-9fb4151e317f): created successfully Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48b5939-e481-412a-8158-365bdf870376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Flow 'volume_create_manager' (d0e6c87d-5d05-427b-8d9f-a133467cefce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:19 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ca7e34b2-6e1c-46f0-8e31-9f59e8f6c3da tempest-SnapshotMetadataTestJSON-458870901 None] Created volume successfully. Jul 15 18:36:19 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505" returned: 0 in 0.648s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:19 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505 Jul 15 18:36:19 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] Creating offline snapshot 7db3d5f7-db37-4226-8689-04e1cc5e5d80 of volume 0e069c3e-be39-4722-8c3a-9fb4151e317f {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a1a393-677c-4a25-a3a7-abdcd602255b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:20 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f Jul 15 18:36:20 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:20 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-735507dd-b9cb-44f2-b1af-6696779cd505" returned: 0 in 0.437s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Lock "cinder-quobyte-735507dd-b9cb-44f2-b1af-6696779cd505" released by "delete_volume" :: held 1.189s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Created reservations ['bac3eddf-05bf-476e-a48d-4ad1157d43d1', '4e10f30e-3927-4575-827c-f1954155f12e', 'c704916f-4019-4f85-92eb-ef7527d774ed', '2dcf4d36-7993-42b6-8baf-e5baa1ee6e40'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:20 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f" returned: 0 in 0.582s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:20 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 1G Jul 15 18:36:20 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:20 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:20 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:20 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.332s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:21 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Deleted volume successfully. Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-731de31d-224b-43b2-b079-192fe778b0be tempest-VolumesCloneTest-346003604 None] Lock "cinder-735507dd-b9cb-44f2-b1af-6696779cd505-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:21 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 1G" returned: 0 in 0.526s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e069c3e-be39-4722-8c3a-9fb4151e317f -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:21 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e069c3e-be39-4722-8c3a-9fb4151e317f -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 Jul 15 18:36:21 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:21 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e069c3e-be39-4722-8c3a-9fb4151e317f -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80" returned: 0 in 0.371s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:21 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 is being set with open permissions: ugo+rw Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:21 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 Jul 15 18:36:21 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Acquiring lock "cinder-a2892618-fa2d-4ad3-9d07-ba7910c60843-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Lock "cinder-a2892618-fa2d-4ad3-9d07-ba7910c60843-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Acquiring lock "cinder-quobyte-a2892618-fa2d-4ad3-9d07-ba7910c60843" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Lock "cinder-quobyte-a2892618-fa2d-4ad3-9d07-ba7910c60843" acquired by "delete_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be0aa75-b5af-4ab6-81de-f8d7869dce12]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:21 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80" returned: 0 in 0.376s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:21 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.info Jul 15 18:36:21 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:22 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 Jul 15 18:36:22 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:22 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.info" returned: 0 in 0.367s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:22 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.info is being set with open permissions: ugo+rw Jul 15 18:36:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:22 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.info Jul 15 18:36:22 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:22 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843" returned: 0 in 0.576s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:22 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843 Jul 15 18:36:22 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:22 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.info" returned: 0 in 0.340s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.698s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:22 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-91f6ebd9-c16a-4671-b92c-208fd0599b6c tempest-SnapshotMetadataTestJSON-458870901 None] Create snapshot completed successfully Jul 15 18:36:22 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2892618-fa2d-4ad3-9d07-ba7910c60843" returned: 0 in 0.369s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Lock "cinder-quobyte-a2892618-fa2d-4ad3-9d07-ba7910c60843" released by "delete_volume" :: held 1.042s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:22 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Created reservations ['953fcba2-315e-44c9-8f10-d0adac88bf2f', '2212c096-4117-4f25-a8d0-955d96bce6c3', '6950f0d8-c720-40be-8e2b-fcea10aafca5', '68756e2c-e26d-4363-ada1-8ee0c5998bd8'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:23 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:23 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:23 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.390s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:23 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:23 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Deleted volume successfully. Jul 15 18:36:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f0c4481c-0ed2-4fc9-a661-698d7f192eb4 tempest-VolumesCloneTest-346003604 None] Lock "cinder-a2892618-fa2d-4ad3-9d07-ba7910c60843-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Acquiring lock "cinder-7db3d5f7-db37-4226-8689-04e1cc5e5d80-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Lock "cinder-7db3d5f7-db37-4226-8689-04e1cc5e5d80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Acquiring lock "cinder-quobyte-0e069c3e-be39-4722-8c3a-9fb4151e317f" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Lock "cinder-quobyte-0e069c3e-be39-4722-8c3a-9fb4151e317f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Acquiring lock "cinder-quobyte-7db3d5f7-db37-4226-8689-04e1cc5e5d80" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Lock "cinder-quobyte-7db3d5f7-db37-4226-8689-04e1cc5e5d80" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Deleting offline snapshot 7db3d5f7-db37-4226-8689-04e1cc5e5d80 of volume 0e069c3e-be39-4722-8c3a-9fb4151e317f {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] snapshot_file for this snap is: volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e33afbc-bfbc-48ce-a24c-4016fa26db2d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:24 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 Jul 15 18:36:24 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:24 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80" returned: 0 in 0.550s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e069c3e-be39-4722-8c3a-9fb4151e317f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[777ab937-7ea8-4b7d-80ae-86d23e29e165]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:24 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f Jul 15 18:36:24 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:25 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f" returned: 0 in 0.510s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:25 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 Jul 15 18:36:25 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:25 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80" returned: 0 in 0.465s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:25 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80 Jul 15 18:36:25 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:26 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f.7db3d5f7-db37-4226-8689-04e1cc5e5d80" returned: 0 in 0.303s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Lock "cinder-quobyte-7db3d5f7-db37-4226-8689-04e1cc5e5d80" released by "_delete_snapshot" :: held 1.999s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Lock "cinder-quobyte-0e069c3e-be39-4722-8c3a-9fb4151e317f" released by "delete_snapshot" :: held 2.030s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:26 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Created reservations ['25d44f23-8c76-4713-9e3f-d4f3a77a3fa2', 'e9075825-824b-4c01-bf14-251512b8da13', 'a12cc1e6-fe21-4da8-86b1-96b50845e369', '8ddd5b12-11ff-4b29-9362-823a72e99628'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:26 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Delete snapshot completed successfully. Jul 15 18:36:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5835b1f2-fc17-4fdc-b107-8bdeeb584660 tempest-SnapshotMetadataTestJSON-458870901 None] Lock "cinder-7db3d5f7-db37-4226-8689-04e1cc5e5d80-delete_snapshot" released by "delete_snapshot" :: held 2.350s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Acquiring lock "cinder-0e069c3e-be39-4722-8c3a-9fb4151e317f-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Lock "cinder-0e069c3e-be39-4722-8c3a-9fb4151e317f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Acquiring lock "cinder-quobyte-0e069c3e-be39-4722-8c3a-9fb4151e317f" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Lock "cinder-quobyte-0e069c3e-be39-4722-8c3a-9fb4151e317f" acquired by "delete_volume" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:27 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d391b2e-7855-4d9a-b617-10af4b8ac098]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:27 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f Jul 15 18:36:27 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:28 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f" returned: 0 in 0.553s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:28 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f Jul 15 18:36:28 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Flow 'volume_create_manager' (eb8493ac-f105-4d63-8e59-b48a03117a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0ce28f-f75d-4f09-8704-18ec10ad2a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0ce28f-f75d-4f09-8704-18ec10ad2a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-269094863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a75e6d3-6fab-42f2-93cd-9ca10bfc6698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5c3db079a14fd38f2bd9c75c14c05d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:28Z,use_quota=True,user_id='da051582d98b4cb7ae91f06fdc14c535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513d75dd-d0ba-4d03-8d33-751172544348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513d75dd-d0ba-4d03-8d33-751172544348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b075b9-3d11-41e7-aa74-71599087cd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:28 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b075b9-3d11-41e7-aa74-71599087cd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a75e6d3-6fab-42f2-93cd-9ca10bfc6698', 'volume_name': 'volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698', 'volume_size': 2}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f370be59-4005-4836-bd00-6e5bccb48124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f370be59-4005-4836-bd00-6e5bccb48124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91c909e-6201-490f-a552-f67109cc3835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:28 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Volume 9a75e6d3-6fab-42f2-93cd-9ca10bfc6698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698', 'volume_size': 2} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-269094863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a75e6d3-6fab-42f2-93cd-9ca10bfc6698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5c3db079a14fd38f2bd9c75c14c05d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:28Z,use_quota=True,user_id='da051582d98b4cb7ae91f06fdc14c535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Creating volume 9a75e6d3-6fab-42f2-93cd-9ca10bfc6698 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:28 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698 2147483648 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0e069c3e-be39-4722-8c3a-9fb4151e317f" returned: 0 in 0.440s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:28 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698 2147483648 Jul 15 18:36:28 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Lock "cinder-quobyte-0e069c3e-be39-4722-8c3a-9fb4151e317f" released by "delete_volume" :: held 1.099s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Created reservations ['99fc4a05-5e24-4d8e-9ee8-ba7941601937', 'b853d0cc-cde8-48de-9b9b-1c250e48fbf2', '7a418318-40ab-4ad8-977a-39e449816045', 'de5fe911-8459-4d1f-bd25-97e4ccd0a068'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:28 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:28 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:29 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.295s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:29 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:29 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Deleted volume successfully. Jul 15 18:36:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f1d7c808-6c9f-4400-b093-75e7cd37dc53 tempest-SnapshotMetadataTestJSON-458870901 None] Lock "cinder-0e069c3e-be39-4722-8c3a-9fb4151e317f-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:29 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698 2147483648" returned: 0 in 0.718s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:29 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698 Jul 15 18:36:29 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:29 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698" returned: 0 in 0.326s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91c909e-6201-490f-a552-f67109cc3835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698', 'volume_size': 2}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d689543-eff5-4c62-8775-9ce0988ef0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:29 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Volume volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698 (9a75e6d3-6fab-42f2-93cd-9ca10bfc6698): created successfully Jul 15 18:36:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d689543-eff5-4c62-8775-9ce0988ef0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Flow 'volume_create_manager' (eb8493ac-f105-4d63-8e59-b48a03117a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:29 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1115fcbf-a33e-45cc-af4b-5ebe535b79f3 tempest-VolumesCloneNegativeTest-669127557 None] Created volume successfully. Jul 15 18:36:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Acquiring lock "cinder-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Lock "cinder-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Acquiring lock "cinder-quobyte-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Lock "cinder-quobyte-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698" acquired by "delete_volume" :: waited 0.027s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:30 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f1af45-ea42-480d-baec-b80ac2152545]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:31 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698 Jul 15 18:36:31 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:31 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698" returned: 0 in 0.487s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:31 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698 Jul 15 18:36:31 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:31 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698" returned: 0 in 0.356s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Lock "cinder-quobyte-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698" released by "delete_volume" :: held 0.892s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:31 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Created reservations ['647748d1-cf35-4f6c-b084-e4c89d1d842a', 'ed68d0b0-0de3-46cb-b176-64963338b60b', '87dc8c26-463f-49ba-8e4b-2fb20109ac2e', '6013f246-b329-41f2-88d2-de698cbc9b7d'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:31 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:31 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:32 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.289s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:32 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Deleted volume successfully. Jul 15 18:36:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f2b80d4-14ec-4d35-92da-4b1885356326 tempest-VolumesCloneNegativeTest-669127557 None] Lock "cinder-9a75e6d3-6fab-42f2-93cd-9ca10bfc6698-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:36:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:32 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:32 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:33 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.407s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:36:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:36:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=140,cinder:SELECT=102,cinder:INSERT=29,cinder:DELETE=12 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=110,cinder:UPDATE=136,cinder:DELETE=11,cinder:INSERT=36 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Flow 'volume_create_manager' (a4d8dc9d-0b7f-4701-ad67-0ef6219d6124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa2b257-b9aa-4a73-8899-74b544fcbe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa2b257-b9aa-4a73-8899-74b544fcbe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1282170712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828c8abf-8298-48b3-9d59-3e7d7a8b08ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e38aece7c8334c2dbf8109f9e0005c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:36Z,use_quota=True,user_id='80f31024c0f04ef699bf1ce91af3fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434c0d5f-214a-47bd-8141-da15fc89aa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434c0d5f-214a-47bd-8141-da15fc89aa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5b31b8-0a12-4ab6-a9c5-8f16d9e550c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5b31b8-0a12-4ab6-a9c5-8f16d9e550c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '828c8abf-8298-48b3-9d59-3e7d7a8b08ad', 'volume_name': 'volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95403b56-7b7a-4c31-b486-483f8990517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95403b56-7b7a-4c31-b486-483f8990517e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d50993-770b-4749-9f20-d70fb5bb4393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:36 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Volume 828c8abf-8298-48b3-9d59-3e7d7a8b08ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad', 'volume_size': 1} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1282170712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828c8abf-8298-48b3-9d59-3e7d7a8b08ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e38aece7c8334c2dbf8109f9e0005c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:36Z,use_quota=True,user_id='80f31024c0f04ef699bf1ce91af3fff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Creating volume 828c8abf-8298-48b3-9d59-3e7d7a8b08ad {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:36 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:36:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:36 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad 1073741824 Jul 15 18:36:36 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:37 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad 1073741824" returned: 0 in 0.746s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:37 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad Jul 15 18:36:37 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:37 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad" returned: 0 in 0.308s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d50993-770b-4749-9f20-d70fb5bb4393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62398cd-cc4b-45e5-94bd-37b9fb2adebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:37 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Volume volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad (828c8abf-8298-48b3-9d59-3e7d7a8b08ad): created successfully Jul 15 18:36:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62398cd-cc4b-45e5-94bd-37b9fb2adebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Flow 'volume_create_manager' (a4d8dc9d-0b7f-4701-ad67-0ef6219d6124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-579ee4e2-0f11-47a6-9b4a-aad83037a17b tempest-VolumesMetadataTest-1402914910 None] Created volume successfully. Jul 15 18:36:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Acquiring lock "cinder-828c8abf-8298-48b3-9d59-3e7d7a8b08ad-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Lock "cinder-828c8abf-8298-48b3-9d59-3e7d7a8b08ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Acquiring lock "cinder-quobyte-828c8abf-8298-48b3-9d59-3e7d7a8b08ad" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Lock "cinder-quobyte-828c8abf-8298-48b3-9d59-3e7d7a8b08ad" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:39 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f666514-3183-4fac-a664-adc73fb3eb33]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:39 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad Jul 15 18:36:39 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:40 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad" returned: 0 in 0.584s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:40 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad Jul 15 18:36:40 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:40 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-828c8abf-8298-48b3-9d59-3e7d7a8b08ad" returned: 0 in 0.352s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Lock "cinder-quobyte-828c8abf-8298-48b3-9d59-3e7d7a8b08ad" released by "delete_volume" :: held 1.011s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:40 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Created reservations ['57d2a7e1-bd49-4dbb-ae2b-2d8795f42a0e', 'e5d5e174-cda9-463f-9e81-d144c84ed071', '619b53be-52f9-49b5-894b-4c7b2b03965e', 'b3c9f18b-beb8-4574-af8c-c9d6b8582cc4'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:41 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:41 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:41 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.404s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:41 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Deleted volume successfully. Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4dc8336b-4775-48f3-88c3-9a00cc65c050 tempest-VolumesMetadataTest-1402914910 None] Lock "cinder-828c8abf-8298-48b3-9d59-3e7d7a8b08ad-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (c2d945b9-0270-4854-8986-e76f5a114857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb06e3e7-6083-42ed-8eab-c6a05fe8608f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb06e3e7-6083-42ed-8eab-c6a05fe8608f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-466341860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6f10c2-b649-42df-842b-f2a3fe72d33a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:41Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029134f2-9b23-4a40-a772-a1efddffa26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029134f2-9b23-4a40-a772-a1efddffa26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65af1ebc-0b59-412b-92a3-cb2358d4912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65af1ebc-0b59-412b-92a3-cb2358d4912b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e6f10c2-b649-42df-842b-f2a3fe72d33a', 'volume_name': 'volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c013a3f4-6777-4817-97c2-79e6c30e046c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c013a3f4-6777-4817-97c2-79e6c30e046c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddc826d-3ff6-40cc-a9ae-be55bf010f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:41 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Volume 3e6f10c2-b649-42df-842b-f2a3fe72d33a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a', 'volume_size': 1} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-466341860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6f10c2-b649-42df-842b-f2a3fe72d33a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:41Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Creating volume 3e6f10c2-b649-42df-842b-f2a3fe72d33a {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:41 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:36:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:41 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a 1073741824 Jul 15 18:36:41 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:42 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a 1073741824" returned: 0 in 0.719s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:42 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a Jul 15 18:36:42 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:42 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a" returned: 0 in 0.488s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddc826d-3ff6-40cc-a9ae-be55bf010f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f73d1ff-d52d-489c-b7b9-7990912800c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:42 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Volume volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a (3e6f10c2-b649-42df-842b-f2a3fe72d33a): created successfully Jul 15 18:36:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f73d1ff-d52d-489c-b7b9-7990912800c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (c2d945b9-0270-4854-8986-e76f5a114857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:43 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-50d1f8f6-bd3f-482c-bdc3-c18e6c7c5a95 tempest-VolumesGetTest-155834816 None] Created volume successfully. Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (1cc46536-553c-45f0-8235-5b1d64468f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4628cd96-d42a-4e31-8ade-0659a6a3cfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4628cd96-d42a-4e31-8ade-0659a6a3cfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-229492150',display_name='tempest-VolumesGetTest-Volume-764634944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f322cd-7bd7-4af3-b69e-050dfcb2b4b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:45Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39dcda93-62d4-4860-bd2e-c6af5ea3dd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39dcda93-62d4-4860-bd2e-c6af5ea3dd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e1d2ee-4453-4739-8c9d-09164c6dc23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e1d2ee-4453-4739-8c9d-09164c6dc23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f322cd-7bd7-4af3-b69e-050dfcb2b4b1', 'volume_name': 'volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a78b5b0-e7ff-4eae-bd48-d1f8bc1bcd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a78b5b0-e7ff-4eae-bd48-d1f8bc1bcd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf83e67-ba32-4d3a-a914-fb2a0f9ecc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:44 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Volume 53f322cd-7bd7-4af3-b69e-050dfcb2b4b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1', 'volume_size': 1} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-229492150',display_name='tempest-VolumesGetTest-Volume-764634944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f322cd-7bd7-4af3-b69e-050dfcb2b4b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:45Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Creating volume 53f322cd-7bd7-4af3-b69e-050dfcb2b4b1 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:44 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:36:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:44 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1 1073741824 Jul 15 18:36:44 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:45 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1 1073741824" returned: 0 in 0.677s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:45 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1 Jul 15 18:36:45 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:45 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1" returned: 0 in 0.303s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf83e67-ba32-4d3a-a914-fb2a0f9ecc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d6abb3-2d09-4fc9-8b81-12bc5d59538b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:46 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Volume volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1 (53f322cd-7bd7-4af3-b69e-050dfcb2b4b1): created successfully Jul 15 18:36:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d6abb3-2d09-4fc9-8b81-12bc5d59538b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (1cc46536-553c-45f0-8235-5b1d64468f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:46 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ce0fea2c-6caa-4435-bf00-a9fc68788fbd tempest-VolumesGetTest-155834816 None] Created volume successfully. Jul 15 18:36:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Lock "cinder-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-quobyte-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:47 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e64c03-236c-47b2-bb40-f1eaafc43d9e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:47 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1 Jul 15 18:36:47 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:47 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1" returned: 0 in 0.552s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:47 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1 Jul 15 18:36:47 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:47 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1" returned: 0 in 0.371s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1" released by "delete_volume" :: held 0.986s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:48 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Created reservations ['5d4a877b-a099-4b4b-9beb-0ead8ae78b7b', '7b9e508d-991f-400f-a910-6e3c88d45278', '2cd9b00a-e2fb-4bd4-84d9-25997bd67f84', '9e641594-0459-4768-ac77-199a36302564'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:48 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:48 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:48 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.394s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:48 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:48 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Deleted volume successfully. Jul 15 18:36:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b1189878-5859-4c55-8975-60f07dfaa05e tempest-VolumesGetTest-155834816 None] Lock "cinder-53f322cd-7bd7-4af3-b69e-050dfcb2b4b1-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-3e6f10c2-b649-42df-842b-f2a3fe72d33a-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Flow 'volume_create_manager' (39ecf3de-6795-421b-bad0-ee289cfb3f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77cb814d-14cc-451d-9e10-78a1473bc048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Lock "cinder-3e6f10c2-b649-42df-842b-f2a3fe72d33a-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77cb814d-14cc-451d-9e10-78a1473bc048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1815276517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e78a8e0-e075-4216-8b39-cc76e24081d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425cb57326ab4899b46a5e2471ceaea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:49Z,use_quota=True,user_id='8c6bc105c4c34ac8a3152d9eb30d1d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43022d42-cb6e-4a03-bf95-32add3203b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43022d42-cb6e-4a03-bf95-32add3203b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68392f06-bea7-4da5-b772-b32abf4c2e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68392f06-bea7-4da5-b772-b32abf4c2e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e78a8e0-e075-4216-8b39-cc76e24081d9', 'volume_name': 'volume-7e78a8e0-e075-4216-8b39-cc76e24081d9', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a035a0-9478-408b-9847-3b515ef9ea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a035a0-9478-408b-9847-3b515ef9ea3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f48b4c7-0182-4084-bfd5-c0a2361c13f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:49 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Volume 7e78a8e0-e075-4216-8b39-cc76e24081d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e78a8e0-e075-4216-8b39-cc76e24081d9', 'volume_size': 1} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1815276517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e78a8e0-e075-4216-8b39-cc76e24081d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425cb57326ab4899b46a5e2471ceaea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:49Z,use_quota=True,user_id='8c6bc105c4c34ac8a3152d9eb30d1d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Creating volume 7e78a8e0-e075-4216-8b39-cc76e24081d9 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:49 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7e78a8e0-e075-4216-8b39-cc76e24081d9 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:49 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7e78a8e0-e075-4216-8b39-cc76e24081d9 1073741824 Jul 15 18:36:49 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-quobyte-3e6f10c2-b649-42df-842b-f2a3fe72d33a" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-3e6f10c2-b649-42df-842b-f2a3fe72d33a" acquired by "delete_volume" :: waited 0.029s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3ad01d-9893-4756-ace0-8eb4ce8bf00c]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:49 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a Jul 15 18:36:49 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:50 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7e78a8e0-e075-4216-8b39-cc76e24081d9 1073741824" returned: 0 in 0.745s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:50 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a" returned: 0 in 0.633s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7e78a8e0-e075-4216-8b39-cc76e24081d9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:50 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a Jul 15 18:36:50 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:50 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7e78a8e0-e075-4216-8b39-cc76e24081d9 Jul 15 18:36:50 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:50 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7e78a8e0-e075-4216-8b39-cc76e24081d9" returned: 0 in 0.409s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f48b4c7-0182-4084-bfd5-c0a2361c13f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e78a8e0-e075-4216-8b39-cc76e24081d9', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0a28d2-e0d2-4ebb-bd7e-b475f9fdaf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:50 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3e6f10c2-b649-42df-842b-f2a3fe72d33a" returned: 0 in 0.504s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-3e6f10c2-b649-42df-842b-f2a3fe72d33a" released by "delete_volume" :: held 1.213s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:50 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Volume volume-7e78a8e0-e075-4216-8b39-cc76e24081d9 (7e78a8e0-e075-4216-8b39-cc76e24081d9): created successfully Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0a28d2-e0d2-4ebb-bd7e-b475f9fdaf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Flow 'volume_create_manager' (39ecf3de-6795-421b-bad0-ee289cfb3f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:50 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0141ad00-3332-47d0-a47a-73ba4619cc2f tempest-VolumesTransfersTest-1421806131 None] Created volume successfully. Jul 15 18:36:50 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Created reservations ['1e2b225b-51d0-4a85-b93b-f9bda440e632', 'd0cd22e3-f2ad-4b98-8185-14db2fdd3556', 'c325edde-101f-44e0-9e64-b7025c97d90f', '46ad7e5d-f335-45ae-a6af-b2c3a0816c4b'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:51 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:51 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:51 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.402s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:51 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:51 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Deleted volume successfully. Jul 15 18:36:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-78693bcf-7cf4-4f47-9742-b493da1dee78 tempest-VolumesGetTest-155834816 None] Lock "cinder-3e6f10c2-b649-42df-842b-f2a3fe72d33a-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:52 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d328a959-5944-4ab8-8724-52e297719a66 tempest-VolumesTransfersTest-2004317008 None] Transfer volume completed successfully. Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (0ec9cc2b-43ed-4280-aa51-6c2de1846ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589739e4-6041-47dd-8cae-4896742c2c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589739e4-6041-47dd-8cae-4896742c2c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-285490719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d8b30e9-4e04-42a3-b645-6c2d4dbf6197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:52Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95a4039-b937-4723-9187-73503ef79b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95a4039-b937-4723-9187-73503ef79b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7d8b57-5dc8-4729-abb7-06f3ff138c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7d8b57-5dc8-4729-abb7-06f3ff138c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d8b30e9-4e04-42a3-b645-6c2d4dbf6197', 'volume_name': 'volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad88ace-c249-40a9-8cca-f1f6e51e20f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad88ace-c249-40a9-8cca-f1f6e51e20f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb665d10-b9b0-45a4-aa84-add0d1b31e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:52 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Volume 6d8b30e9-4e04-42a3-b645-6c2d4dbf6197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197', 'volume_size': 1} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-285490719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d8b30e9-4e04-42a3-b645-6c2d4dbf6197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:52Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Creating volume 6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:36:52 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:36:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:52 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 1073741824 Jul 15 18:36:52 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Acquiring lock "cinder-7e78a8e0-e075-4216-8b39-cc76e24081d9-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Lock "cinder-7e78a8e0-e075-4216-8b39-cc76e24081d9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Acquiring lock "cinder-quobyte-7e78a8e0-e075-4216-8b39-cc76e24081d9" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Lock "cinder-quobyte-7e78a8e0-e075-4216-8b39-cc76e24081d9" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:53 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 1073741824" returned: 0 in 0.797s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfb6fe7-bc15-47cb-9df1-a263df16dd9a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7e78a8e0-e075-4216-8b39-cc76e24081d9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:53 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 Jul 15 18:36:53 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:53 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7e78a8e0-e075-4216-8b39-cc76e24081d9 Jul 15 18:36:53 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:53 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7e78a8e0-e075-4216-8b39-cc76e24081d9" returned: 0 in 0.476s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7e78a8e0-e075-4216-8b39-cc76e24081d9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:53 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197" returned: 0 in 0.458s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:53 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7e78a8e0-e075-4216-8b39-cc76e24081d9 Jul 15 18:36:53 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb665d10-b9b0-45a4-aa84-add0d1b31e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b59a48-474a-47e4-8c53-4d23ec12fb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:54 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Volume volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 (6d8b30e9-4e04-42a3-b645-6c2d4dbf6197): created successfully Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b59a48-474a-47e4-8c53-4d23ec12fb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (0ec9cc2b-43ed-4280-aa51-6c2de1846ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8d79fa07-3002-4db5-89ed-34a29be4f669 tempest-VolumesGetTest-155834816 None] Created volume successfully. Jul 15 18:36:54 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7e78a8e0-e075-4216-8b39-cc76e24081d9" returned: 0 in 0.420s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Lock "cinder-quobyte-7e78a8e0-e075-4216-8b39-cc76e24081d9" released by "delete_volume" :: held 0.972s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Created reservations ['259f53c3-946b-43db-923c-876054720bbc', 'c34bd769-538e-437b-9f4b-e4cdbe9f9cea', '1db0fd7e-09f7-4f36-b189-ad91b6b04b1f', 'c603d43c-5478-49d0-9f7f-89b6993b4eee'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:54 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:36:54 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:54 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.357s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:54 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:36:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Deleted volume successfully. Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f3a299f1-ef12-4daa-8ea1-f3e6311f9965 tempest-VolumesTransfersTest-1085725947 None] Lock "cinder-7e78a8e0-e075-4216-8b39-cc76e24081d9-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (72f2a04a-5e66-4d9d-b818-0f42d596f44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0157ce-4d38-44fc-ab51-6adf6b6c4a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0157ce-4d38-44fc-ab51-6adf6b6c4a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-479405897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6d8b30e9-4e04-42a3-b645-6c2d4dbf6197,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:55Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a73fe4-b04f-418c-9e5e-003ebe8108b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a73fe4-b04f-418c-9e5e-003ebe8108b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a042047-be45-44cd-b9fa-7a134fc291a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a042047-be45-44cd-b9fa-7a134fc291a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a', 'volume_name': 'volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a', 'volume_size': 1, 'source_volid': '6d8b30e9-4e04-42a3-b645-6c2d4dbf6197', 'source_volstatus': 'available'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26bb7d6-79ac-474b-bf38-660317b487fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26bb7d6-79ac-474b-bf38-660317b487fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5fc09b-d5a7-4de7-bb1c-5fec7bcf8c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:55 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Volume 4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a', 'volume_size': 1, 'source_volid': '6d8b30e9-4e04-42a3-b645-6c2d4dbf6197', 'source_volstatus': 'available'} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:55 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Cloning volume 6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 to volume 4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Creating offline snapshot adbea321-578a-49c8-a868-4c5ae520984a of volume 6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[82162d78-ed90-41e8-ab72-55596464b3b0]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:55 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 Jul 15 18:36:55 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:56 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197" returned: 0 in 1.103s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:56 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a 1G Jul 15 18:36:56 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Flow 'volume_create_manager' (e8916bda-1c92-4b28-9050-cd5878205dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5a0678-e8be-44e9-bba2-2fc980d77e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5a0678-e8be-44e9-bba2-2fc980d77e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-761710936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66bac59-ac79-4e16-8ec2-95442c214b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425cb57326ab4899b46a5e2471ceaea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:57Z,use_quota=True,user_id='8c6bc105c4c34ac8a3152d9eb30d1d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f96675a-5265-4006-9734-9d05aa285e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f96675a-5265-4006-9734-9d05aa285e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4c7932-ba91-48be-ac1c-80cc38a51b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4c7932-ba91-48be-ac1c-80cc38a51b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66bac59-ac79-4e16-8ec2-95442c214b21', 'volume_name': 'volume-c66bac59-ac79-4e16-8ec2-95442c214b21', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a5c234d-99de-4746-9b4a-bc7571f7dfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a5c234d-99de-4746-9b4a-bc7571f7dfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865b0742-e2ef-4a9d-bd58-75cd027fd16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:36:57 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Volume c66bac59-ac79-4e16-8ec2-95442c214b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66bac59-ac79-4e16-8ec2-95442c214b21', 'volume_size': 1} Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:57 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a 1G" returned: 0 in 0.883s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:57 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a Jul 15 18:36:57 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:58 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a" returned: 0 in 0.477s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:58 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a is being set with open permissions: ugo+rw Jul 15 18:36:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:58 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a Jul 15 18:36:58 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:58 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a" returned: 0 in 0.333s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:58 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.info Jul 15 18:36:58 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:58 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.info" returned: 0 in 0.349s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:58 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.info is being set with open permissions: ugo+rw Jul 15 18:36:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:58 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.info Jul 15 18:36:58 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:36:59 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 15 18:36:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.info" returned: 0 in 0.735s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:36:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-quobyte-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a" by "_copy_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:36:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:36:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] snapshot: adbea321-578a-49c8-a868-4c5ae520984a, volume: 4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a, {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:36:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:36:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:36:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:36:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:36:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:36:59 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e921ae0e-07b0-4348-86a1-15497c19339a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:36:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:36:59 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a Jul 15 18:36:59 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:00 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a" returned: 0 in 0.566s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:37:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:37:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Creating direct copy from snapshot {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:37:00 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ab15dc-e0ec-4b33-845d-99402dce137d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:00 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 Jul 15 18:37:00 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:00 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197" returned: 0 in 0.629s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:00 devstack cinder-volume[87217]: DEBUG cinder.utils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Path /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a not found in is_blk_device check {{(pid=87217) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:37:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:01 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a Jul 15 18:37:01 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:08 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=35,cinder:UPDATE=50,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:37:08 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=35,cinder:INSERT=12,cinder:UPDATE=46,cinder:DELETE=6 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:37:09 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a" returned: 0 in 8.740s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:09 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[24851b0c-178f-45f2-a64c-43f5abf3df04]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:09 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 Jul 15 18:37:09 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:10 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Flow 'volume_create_manager' (6a2153c9-1b2f-4e4f-a04b-5a310ecade23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a551029-5e2d-4d37-b960-c56251d97a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197" returned: 0 in 0.697s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197, size 1024.00 MB, duration 8.74 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:37:10 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Converted 1024.00 MB image at 117.14 MB/s Jul 15 18:37:10 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a is being set with open permissions: ugo+rw Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a551029-5e2d-4d37-b960-c56251d97a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1147920833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75da9cc-0688-4bf7-9394-43c72e8b0834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaf53ec462549789598607706607008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:10Z,use_quota=True,user_id='69fc804bd91a4c0996bd1b2ee34fcf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99da962f-10a9-41f6-9897-963f99ca735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:10 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a Jul 15 18:37:10 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99da962f-10a9-41f6-9897-963f99ca735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a9199c-16c5-470b-a0a2-2b1906a85830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a9199c-16c5-470b-a0a2-2b1906a85830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a75da9cc-0688-4bf7-9394-43c72e8b0834', 'volume_name': 'volume-a75da9cc-0688-4bf7-9394-43c72e8b0834', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be0a92a-8967-4f12-ae46-00f73175c414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be0a92a-8967-4f12-ae46-00f73175c414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1a99f1-7919-4591-a1b5-94b2aae97d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:10 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Volume a75da9cc-0688-4bf7-9394-43c72e8b0834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a75da9cc-0688-4bf7-9394-43c72e8b0834', 'volume_size': 1} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:10 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a" returned: 0 in 0.302s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a" released by "_copy_volume_from_snapshot" :: held 11.091s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-quobyte-adbea321-578a-49c8-a868-4c5ae520984a" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-adbea321-578a-49c8-a868-4c5ae520984a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Deleting offline snapshot adbea321-578a-49c8-a868-4c5ae520984a of volume 6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] snapshot_file for this snap is: volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf68b8-53c4-4df3-a306-4344176b5609]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:10 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a Jul 15 18:37:10 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:11 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a" returned: 0 in 0.447s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:37:11 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9274c2-f34e-49ee-b77c-6f5213e50587]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:11 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 Jul 15 18:37:11 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:11 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197" returned: 0 in 0.374s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:11 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a Jul 15 18:37:11 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:12 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a" returned: 0 in 0.337s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:12 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a Jul 15 18:37:12 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:12 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197.adbea321-578a-49c8-a868-4c5ae520984a" returned: 0 in 0.254s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-adbea321-578a-49c8-a868-4c5ae520984a" released by "_delete_snapshot" :: held 1.527s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.848s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.867s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-761710936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66bac59-ac79-4e16-8ec2-95442c214b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425cb57326ab4899b46a5e2471ceaea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:36:57Z,use_quota=True,user_id='8c6bc105c4c34ac8a3152d9eb30d1d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Creating volume c66bac59-ac79-4e16-8ec2-95442c214b21 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:12 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c66bac59-ac79-4e16-8ec2-95442c214b21 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5fc09b-d5a7-4de7-bb1c-5fec7bcf8c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a', 'volume_size': 1, 'source_volid': '6d8b30e9-4e04-42a3-b645-6c2d4dbf6197', 'source_volstatus': 'available'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:12 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c66bac59-ac79-4e16-8ec2-95442c214b21 1073741824 Jul 15 18:37:12 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20af953a-960a-45ea-8850-89a78ffb7632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:12 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Volume volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a (4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a): created successfully Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20af953a-960a-45ea-8850-89a78ffb7632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (72f2a04a-5e66-4d9d-b818-0f42d596f44e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:12 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-fb30593f-9d0d-4669-bf6d-f42a4a884ff0 tempest-VolumesGetTest-155834816 None] Created volume successfully. Jul 15 18:37:12 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c66bac59-ac79-4e16-8ec2-95442c214b21 1073741824" returned: 0 in 0.435s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c66bac59-ac79-4e16-8ec2-95442c214b21 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:12 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c66bac59-ac79-4e16-8ec2-95442c214b21 Jul 15 18:37:12 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:13 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c66bac59-ac79-4e16-8ec2-95442c214b21" returned: 0 in 0.268s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.629s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1147920833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75da9cc-0688-4bf7-9394-43c72e8b0834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaf53ec462549789598607706607008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:10Z,use_quota=True,user_id='69fc804bd91a4c0996bd1b2ee34fcf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Creating volume a75da9cc-0688-4bf7-9394-43c72e8b0834 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:13 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a75da9cc-0688-4bf7-9394-43c72e8b0834 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865b0742-e2ef-4a9d-bd58-75cd027fd16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66bac59-ac79-4e16-8ec2-95442c214b21', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3defe232-0073-420b-94e2-fba8c6cd7829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:13 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a75da9cc-0688-4bf7-9394-43c72e8b0834 1073741824 Jul 15 18:37:13 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:13 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Volume volume-c66bac59-ac79-4e16-8ec2-95442c214b21 (c66bac59-ac79-4e16-8ec2-95442c214b21): created successfully Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3defe232-0073-420b-94e2-fba8c6cd7829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Flow 'volume_create_manager' (e8916bda-1c92-4b28-9050-cd5878205dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:13 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-964c1ff7-61d1-4b46-ab08-5e801f0dc576 tempest-VolumesTransfersTest-1421806131 None] Created volume successfully. Jul 15 18:37:13 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (0539a0b5-44c4-4d24-8baa-e4b03d13bf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4569d008-02aa-466c-90a6-ade1612f7d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a75da9cc-0688-4bf7-9394-43c72e8b0834 1073741824" returned: 0 in 0.668s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4569d008-02aa-466c-90a6-ade1612f7d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1080596233',display_name='tempest-VolumesGetTest-Volume-1347930960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b44da7-b9be-4b9d-a4c2-cac98204c016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:14Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589819be-f9d2-4ef1-9e0b-038b31740282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589819be-f9d2-4ef1-9e0b-038b31740282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e2ff76-2aaf-4a55-8dd4-648c31fe57e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e2ff76-2aaf-4a55-8dd4-648c31fe57e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b44da7-b9be-4b9d-a4c2-cac98204c016', 'volume_name': 'volume-98b44da7-b9be-4b9d-a4c2-cac98204c016', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4146916-a832-439e-9f7b-dedfaccd1004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4146916-a832-439e-9f7b-dedfaccd1004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f12a97-3b3a-4554-885c-26a65874299b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:13 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Volume 98b44da7-b9be-4b9d-a4c2-cac98204c016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b44da7-b9be-4b9d-a4c2-cac98204c016', 'volume_size': 1} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a75da9cc-0688-4bf7-9394-43c72e8b0834 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:13 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a75da9cc-0688-4bf7-9394-43c72e8b0834 Jul 15 18:37:13 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:14 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a75da9cc-0688-4bf7-9394-43c72e8b0834" returned: 0 in 0.257s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1080596233',display_name='tempest-VolumesGetTest-Volume-1347930960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b44da7-b9be-4b9d-a4c2-cac98204c016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:14Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Creating volume 98b44da7-b9be-4b9d-a4c2-cac98204c016 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:14 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-98b44da7-b9be-4b9d-a4c2-cac98204c016 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:14 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-98b44da7-b9be-4b9d-a4c2-cac98204c016 1073741824 Jul 15 18:37:14 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1a99f1-7919-4591-a1b5-94b2aae97d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a75da9cc-0688-4bf7-9394-43c72e8b0834', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0cf7a4-17fe-4cd7-b7da-c7ce04a7d286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:14 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Volume volume-a75da9cc-0688-4bf7-9394-43c72e8b0834 (a75da9cc-0688-4bf7-9394-43c72e8b0834): created successfully Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0cf7a4-17fe-4cd7-b7da-c7ce04a7d286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Flow 'volume_create_manager' (6a2153c9-1b2f-4e4f-a04b-5a310ecade23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:14 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1eb3387d-4f03-483d-a2f9-b585b1137070 tempest-VolumesActionsTest-975804044 None] Created volume successfully. Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3936d241-a6a3-4735-aaaa-f12006ecc0c2 tempest-VolumesActionsTest-975804044 None] Acquiring lock "cinder-a75da9cc-0688-4bf7-9394-43c72e8b0834" by "attach_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3936d241-a6a3-4735-aaaa-f12006ecc0c2 tempest-VolumesActionsTest-975804044 None] Lock "cinder-a75da9cc-0688-4bf7-9394-43c72e8b0834" acquired by "attach_volume" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Acquiring lock "cinder-c66bac59-ac79-4e16-8ec2-95442c214b21-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Lock "cinder-c66bac59-ac79-4e16-8ec2-95442c214b21-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:14 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-3936d241-a6a3-4735-aaaa-f12006ecc0c2 tempest-VolumesActionsTest-975804044 None] Attaching volume a75da9cc-0688-4bf7-9394-43c72e8b0834 to instance 41716274-0527-4929-b634-216d4e05a7a3 at mountpoint /dev/vdb on host None. Jul 15 18:37:14 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-98b44da7-b9be-4b9d-a4c2-cac98204c016 1073741824" returned: 0 in 0.635s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Acquiring lock "cinder-quobyte-c66bac59-ac79-4e16-8ec2-95442c214b21" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:14 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-3936d241-a6a3-4735-aaaa-f12006ecc0c2 tempest-VolumesActionsTest-975804044 None] Attach volume completed successfully. Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Lock "cinder-quobyte-c66bac59-ac79-4e16-8ec2-95442c214b21" acquired by "delete_volume" :: waited 0.035s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3936d241-a6a3-4735-aaaa-f12006ecc0c2 tempest-VolumesActionsTest-975804044 None] Lock "cinder-a75da9cc-0688-4bf7-9394-43c72e8b0834" released by "attach_volume" :: held 0.286s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd6d0dd-55d2-44fa-a517-2de5902dd0f4]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c66bac59-ac79-4e16-8ec2-95442c214b21 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-98b44da7-b9be-4b9d-a4c2-cac98204c016 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:15 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-98b44da7-b9be-4b9d-a4c2-cac98204c016 Jul 15 18:37:15 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:15 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c66bac59-ac79-4e16-8ec2-95442c214b21 Jul 15 18:37:15 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:15 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-98b44da7-b9be-4b9d-a4c2-cac98204c016" returned: 0 in 0.317s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f12a97-3b3a-4554-885c-26a65874299b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b44da7-b9be-4b9d-a4c2-cac98204c016', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49720e7c-7595-42eb-b357-fb7de8c659a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:15 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Volume volume-98b44da7-b9be-4b9d-a4c2-cac98204c016 (98b44da7-b9be-4b9d-a4c2-cac98204c016): created successfully Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49720e7c-7595-42eb-b357-fb7de8c659a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (0539a0b5-44c4-4d24-8baa-e4b03d13bf7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:15 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c66bac59-ac79-4e16-8ec2-95442c214b21" returned: 0 in 0.443s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c66bac59-ac79-4e16-8ec2-95442c214b21 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:15 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-75854250-2107-4653-a2db-0846b1744a35 tempest-VolumesGetTest-155834816 None] Created volume successfully. Jul 15 18:37:15 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c66bac59-ac79-4e16-8ec2-95442c214b21 Jul 15 18:37:15 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:15 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f48bae88-cf38-4e3f-84db-e34a30b103c6 tempest-VolumesActionsTest-811256345 None] Terminate volume connection completed successfully. Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f48bae88-cf38-4e3f-84db-e34a30b103c6 tempest-VolumesActionsTest-811256345 None] Acquiring lock "cinder-a75da9cc-0688-4bf7-9394-43c72e8b0834-detach_volume" by "detach_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f48bae88-cf38-4e3f-84db-e34a30b103c6 tempest-VolumesActionsTest-811256345 None] Lock "cinder-a75da9cc-0688-4bf7-9394-43c72e8b0834-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:15 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f48bae88-cf38-4e3f-84db-e34a30b103c6 tempest-VolumesActionsTest-811256345 None] Detaching volume a75da9cc-0688-4bf7-9394-43c72e8b0834 from instance 41716274-0527-4929-b634-216d4e05a7a3. Jul 15 18:37:15 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c66bac59-ac79-4e16-8ec2-95442c214b21" returned: 0 in 0.288s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Lock "cinder-quobyte-c66bac59-ac79-4e16-8ec2-95442c214b21" released by "delete_volume" :: held 0.791s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:15 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f48bae88-cf38-4e3f-84db-e34a30b103c6 tempest-VolumesActionsTest-811256345 None] Detach volume completed successfully. Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f48bae88-cf38-4e3f-84db-e34a30b103c6 tempest-VolumesActionsTest-811256345 None] Lock "cinder-a75da9cc-0688-4bf7-9394-43c72e8b0834-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Created reservations ['ce309210-3a97-40cd-9906-768a14c39630', 'f4861949-6a7e-4721-a81e-9c3a271afcda', 'ea93e80e-a99c-4545-bd2a-7f78bf90d8ca', 'e38d596b-8ce9-4d3c-ac0d-43369859cc3b'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:15 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:15 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-04772e91-f0bd-44b1-a0dc-0c3984db2210 tempest-VolumesActionsTest-975804044 None] Acquiring lock "cinder-a75da9cc-0688-4bf7-9394-43c72e8b0834-detach_volume" by "detach_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-04772e91-f0bd-44b1-a0dc-0c3984db2210 tempest-VolumesActionsTest-975804044 None] Lock "cinder-a75da9cc-0688-4bf7-9394-43c72e8b0834-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:16 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-04772e91-f0bd-44b1-a0dc-0c3984db2210 tempest-VolumesActionsTest-975804044 None] Volume detach called, but volume not attached. Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-04772e91-f0bd-44b1-a0dc-0c3984db2210 tempest-VolumesActionsTest-975804044 None] Lock "cinder-a75da9cc-0688-4bf7-9394-43c72e8b0834-detach_volume" released by "detach_volume" :: held 0.021s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:16 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.298s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:16 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Deleted volume successfully. Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b151dfb8-ee64-49d2-9656-49eb25b8af5d tempest-VolumesTransfersTest-1085725947 None] Lock "cinder-c66bac59-ac79-4e16-8ec2-95442c214b21-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-98b44da7-b9be-4b9d-a4c2-cac98204c016-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Lock "cinder-98b44da7-b9be-4b9d-a4c2-cac98204c016-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-quobyte-98b44da7-b9be-4b9d-a4c2-cac98204c016" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-98b44da7-b9be-4b9d-a4c2-cac98204c016" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[279b587c-9096-4f01-8f15-e0c6d8abbb18]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Acquiring lock "cinder-a75da9cc-0688-4bf7-9394-43c72e8b0834-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-98b44da7-b9be-4b9d-a4c2-cac98204c016 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Lock "cinder-a75da9cc-0688-4bf7-9394-43c72e8b0834-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Acquiring lock "cinder-quobyte-a75da9cc-0688-4bf7-9394-43c72e8b0834" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Lock "cinder-quobyte-a75da9cc-0688-4bf7-9394-43c72e8b0834" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d308f9a7-0c1a-4411-a168-d8e91def65fd]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a75da9cc-0688-4bf7-9394-43c72e8b0834 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:16 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-98b44da7-b9be-4b9d-a4c2-cac98204c016 Jul 15 18:37:16 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:16 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a75da9cc-0688-4bf7-9394-43c72e8b0834 Jul 15 18:37:16 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:16 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-98b44da7-b9be-4b9d-a4c2-cac98204c016" returned: 0 in 0.429s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-98b44da7-b9be-4b9d-a4c2-cac98204c016 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:16 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-98b44da7-b9be-4b9d-a4c2-cac98204c016 Jul 15 18:37:16 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:16 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a75da9cc-0688-4bf7-9394-43c72e8b0834" returned: 0 in 0.400s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a75da9cc-0688-4bf7-9394-43c72e8b0834 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:16 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a75da9cc-0688-4bf7-9394-43c72e8b0834 Jul 15 18:37:16 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:17 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-98b44da7-b9be-4b9d-a4c2-cac98204c016" returned: 0 in 0.305s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-98b44da7-b9be-4b9d-a4c2-cac98204c016" released by "delete_volume" :: held 0.807s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Created reservations ['208b1aac-c2f8-46c4-83d1-4b68b0dba308', '9323f0ae-bbda-408b-94c9-ea61d3941638', 'a74e3420-d40e-41b1-a261-deed785f3f2f', '4d1f64d6-2bb8-4666-b2b3-cb23ebbe0040'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:17 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a75da9cc-0688-4bf7-9394-43c72e8b0834" returned: 0 in 0.346s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Lock "cinder-quobyte-a75da9cc-0688-4bf7-9394-43c72e8b0834" released by "delete_volume" :: held 0.800s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:17 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:17 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Created reservations ['c8d15617-eae6-445a-b6c5-340153b35b19', '8664c689-822d-4c47-9a85-d1b631dd3909', '4ae2de8a-0525-4f43-b141-c5bf5564ef5f', 'e5b62675-2d64-4167-aa9c-f6c4ca86a98f'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Lock "cinder-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-quobyte-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a" acquired by "delete_volume" :: waited 0.067s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:17 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:17 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a87b22c-1ac2-4e3a-8dc8-e79818acae26]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:17 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.534s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:17 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Deleted volume successfully. Jul 15 18:37:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-cb02e1ab-3b81-4ab1-ae08-80e4d36979bc tempest-VolumesGetTest-155834816 None] Lock "cinder-98b44da7-b9be-4b9d-a4c2-cac98204c016-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:18 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a Jul 15 18:37:18 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:18 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.581s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:18 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:18 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Deleted volume successfully. Jul 15 18:37:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bf21db7d-d38b-44df-a2b3-3d457427f28f tempest-VolumesActionsTest-975804044 None] Lock "cinder-a75da9cc-0688-4bf7-9394-43c72e8b0834-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:18 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a" returned: 0 in 0.798s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:18 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a Jul 15 18:37:18 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:19 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a" returned: 0 in 0.442s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:19 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a" released by "delete_volume" :: held 1.322s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:19 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Created reservations ['ecc56238-06a2-4953-ab13-9571a34aa014', '6ed8120a-a493-41a5-b3fb-619524a802e2', 'ec16a127-dd70-4640-a105-bec53131bf89', '75298f60-80a9-44ab-8d1f-2faa1237cae7'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:19 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:19 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:19 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.695s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:20 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:20 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Deleted volume successfully. Jul 15 18:37:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-72766e8c-68ef-409c-aed5-03cc4da65be3 tempest-VolumesGetTest-155834816 None] Lock "cinder-4ca60c8d-2e7c-4b4a-aa76-4fe45e3c8d9a-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Lock "cinder-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-quobyte-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:20 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb9a407-f369-4732-90a2-e3777b0ebac9]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:20 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 Jul 15 18:37:20 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:20 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197" returned: 0 in 0.628s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:20 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197 Jul 15 18:37:20 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:21 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197" returned: 0 in 0.325s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197" released by "delete_volume" :: held 1.045s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Created reservations ['307155b2-5845-418b-b25d-d8dcb3b44339', '1d21680b-a851-4502-91c4-b329b1782bc3', '13e29fbe-e2b9-4ecf-8881-50b424a70829', 'bd588f12-a04b-4422-b120-4378ceb0cdcf'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:21 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:21 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Flow 'volume_create_manager' (2e3bdca8-93d4-4638-9673-69159cad75f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a316564-98e2-4f3b-8e64-c840d84e0fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:21 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a316564-98e2-4f3b-8e64-c840d84e0fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-215548442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f7118b-f924-4247-af27-8ea04f42b797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eac6ba66bb1426bad1d372d5931e949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:22Z,use_quota=True,user_id='7433aea7986041789578d9f29e2a97ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ede3d4-6cf6-4831-b23c-574d6133a70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ede3d4-6cf6-4831-b23c-574d6133a70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adc549a-fcd8-4abb-98af-db211e4be4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adc549a-fcd8-4abb-98af-db211e4be4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f7118b-f924-4247-af27-8ea04f42b797', 'volume_name': 'volume-02f7118b-f924-4247-af27-8ea04f42b797', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0c64bc-2850-4154-a40f-80d46f8a176f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0c64bc-2850-4154-a40f-80d46f8a176f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16a0c71-161d-4cdd-bb57-e82b6a41729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:21 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Volume 02f7118b-f924-4247-af27-8ea04f42b797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f7118b-f924-4247-af27-8ea04f42b797', 'volume_size': 1} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-215548442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f7118b-f924-4247-af27-8ea04f42b797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eac6ba66bb1426bad1d372d5931e949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:22Z,use_quota=True,user_id='7433aea7986041789578d9f29e2a97ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Creating volume 02f7118b-f924-4247-af27-8ea04f42b797 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:21 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.377s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:21 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Deleted volume successfully. Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:21 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797 1073741824 Jul 15 18:37:21 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Flow 'volume_create_manager' (d89ae5b5-0227-4da1-a545-cd9d9817bdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23002e8d-e714-406d-9755-49829a0bb77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23002e8d-e714-406d-9755-49829a0bb77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1101356886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d684ce-ac23-4a4a-abc8-d97c3e397023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaf53ec462549789598607706607008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:22Z,use_quota=True,user_id='69fc804bd91a4c0996bd1b2ee34fcf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8ba026-aa86-4def-8112-211498bb7c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8ba026-aa86-4def-8112-211498bb7c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17db4eb-9567-46df-b05e-187c930a8253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17db4eb-9567-46df-b05e-187c930a8253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d684ce-ac23-4a4a-abc8-d97c3e397023', 'volume_name': 'volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73575f3-56d1-4972-ac97-c9caea6055ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73575f3-56d1-4972-ac97-c9caea6055ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9434fc1-919c-4092-88b1-76fb5663d7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:22 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Volume c1d684ce-ac23-4a4a-abc8-d97c3e397023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023', 'volume_size': 1} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4e768a32-128f-4434-8d5c-c273e055c8a6 tempest-VolumesGetTest-155834816 None] Lock "cinder-6d8b30e9-4e04-42a3-b645-6c2d4dbf6197-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:22 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797 1073741824" returned: 0 in 0.494s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:22 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797 Jul 15 18:37:22 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:22 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797" returned: 0 in 0.302s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.727s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1101356886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d684ce-ac23-4a4a-abc8-d97c3e397023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaf53ec462549789598607706607008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:22Z,use_quota=True,user_id='69fc804bd91a4c0996bd1b2ee34fcf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Creating volume c1d684ce-ac23-4a4a-abc8-d97c3e397023 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:22 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:22 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023 1073741824 Jul 15 18:37:22 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16a0c71-161d-4cdd-bb57-e82b6a41729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f7118b-f924-4247-af27-8ea04f42b797', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967ba0bc-9138-4893-8470-cf93fd2ef611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:22 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Volume volume-02f7118b-f924-4247-af27-8ea04f42b797 (02f7118b-f924-4247-af27-8ea04f42b797): created successfully Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967ba0bc-9138-4893-8470-cf93fd2ef611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Flow 'volume_create_manager' (2e3bdca8-93d4-4638-9673-69159cad75f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:22 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c7ac2a31-a356-4c2e-8e8e-5b1a414d6fd4 tempest-AttachVolumeNegativeTest-1381542441 None] Created volume successfully. Jul 15 18:37:23 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023 1073741824" returned: 0 in 0.546s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:23 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023 Jul 15 18:37:23 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (f2b4d9e1-6537-436c-9eff-3ea882ad6e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3676a36e-46ea-479b-b4cc-57c89986ed4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3676a36e-46ea-479b-b4cc-57c89986ed4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-206582347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fad8d7d-da45-4c75-bc90-b8d22a37d3d1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:23Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98034ca1-5450-4aca-b387-8c5b8f9a9dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98034ca1-5450-4aca-b387-8c5b8f9a9dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0068741b-1197-4c31-8fb5-2627eb885991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.image.glance [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Creating Keystone auth plugin from conf {{(pid=87217) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:37:23 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023" returned: 0 in 0.304s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9434fc1-919c-4092-88b1-76fb5663d7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648c4ff9-7634-4653-87f0-8e7bca217ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:23 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Volume volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023 (c1d684ce-ac23-4a4a-abc8-d97c3e397023): created successfully Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648c4ff9-7634-4653-87f0-8e7bca217ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Flow 'volume_create_manager' (d89ae5b5-0227-4da1-a545-cd9d9817bdab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:23 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-cabe3dd5-0396-4544-9248-e0e424d9827e tempest-VolumesActionsTest-975804044 None] Created volume successfully. Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0068741b-1197-4c31-8fb5-2627eb885991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2fad8d7d-da45-4c75-bc90-b8d22a37d3d1', 'volume_name': 'volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1', 'volume_size': 1, 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1cc7d7f865b4961944a3804db21f9fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'created_at': datetime.datetime(2026, 7, 15, 16, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58cd658a-6d16-40ff-85de-7b9a03ec1256/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63594a3-ac61-443f-81a8-64d19a21aacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63594a3-ac61-443f-81a8-64d19a21aacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d44d768-ac04-4534-835d-ffadbeca0179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:23 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Volume 2fad8d7d-da45-4c75-bc90-b8d22a37d3d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1', 'volume_size': 1, 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1cc7d7f865b4961944a3804db21f9fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'created_at': datetime.datetime(2026, 7, 15, 16, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58cd658a-6d16-40ff-85de-7b9a03ec1256/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 15 18:37:23 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Trying to clone 2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 from image 58cd658a-6d16-40ff-85de-7b9a03ec1256 at location (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]). {{(pid=87217) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:37:24 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:37:24 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Image download 20.69 MB at 20.69 MB/s Jul 15 18:37:24 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27ff1f1-19d9-4b67-9909-b36552daab82]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:24 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD Jul 15 18:37:24 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-84bf8df2-f515-451b-8ac5-d9ecbab88852 req-71c5d01f-b97e-4314-8dd4-ec541b11b668 tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-84bf8df2-f515-451b-8ac5-d9ecbab88852 req-71c5d01f-b97e-4314-8dd4-ec541b11b668 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:24 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4affa2f-b2af-43a4-92ea-acd2e900ce11]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-84bf8df2-f515-451b-8ac5-d9ecbab88852 req-71c5d01f-b97e-4314-8dd4-ec541b11b668 tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:25 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Temporary image 58cd658a-6d16-40ff-85de-7b9a03ec1256 is fetched for user d23f5666db0147cbbee49d73101b4336. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:37:25 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797 Jul 15 18:37:25 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Acquiring lock "cinder-c1d684ce-ac23-4a4a-abc8-d97c3e397023-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4565c279-3d57-4dbf-bc32-a3d63a8c9405]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Lock "cinder-c1d684ce-ac23-4a4a-abc8-d97c3e397023-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Acquiring lock "cinder-quobyte-c1d684ce-ac23-4a4a-abc8-d97c3e397023" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Lock "cinder-quobyte-c1d684ce-ac23-4a4a-abc8-d97c3e397023" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:25 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD Jul 15 18:37:25 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ecfe79-46ed-4c34-8679-8deefda89131]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:25 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-84bf8df2-f515-451b-8ac5-d9ecbab88852 req-71c5d01f-b97e-4314-8dd4-ec541b11b668 tempest-AttachVolumeNegativeTest-1381542441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797" returned: 0 in 0.462s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-84bf8df2-f515-451b-8ac5-d9ecbab88852 req-71c5d01f-b97e-4314-8dd4-ec541b11b668 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.489s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-84bf8df2-f515-451b-8ac5-d9ecbab88852 req-71c5d01f-b97e-4314-8dd4-ec541b11b668 tempest-AttachVolumeNegativeTest-1381542441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-02f7118b-f924-4247-af27-8ea04f42b797', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e05d90e1-c804-47a9-8946-879ed1b48edd', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:37:25 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023 Jul 15 18:37:25 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:25 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-84bf8df2-f515-451b-8ac5-d9ecbab88852 req-71c5d01f-b97e-4314-8dd4-ec541b11b668 tempest-AttachVolumeNegativeTest-1381542441 None] attachment_update completed successfully. Jul 15 18:37:25 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-206582347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fad8d7d-da45-4c75-bc90-b8d22a37d3d1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:23Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Creating volume 2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:25 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:25 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 1073741824 Jul 15 18:37:25 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:25 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023" returned: 0 in 0.477s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:25 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023 Jul 15 18:37:25 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:26 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1d684ce-ac23-4a4a-abc8-d97c3e397023" returned: 0 in 0.315s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Lock "cinder-quobyte-c1d684ce-ac23-4a4a-abc8-d97c3e397023" released by "delete_volume" :: held 0.862s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Created reservations ['350afaea-50c9-467f-b7d5-aefdbc235757', '3ba14ab2-5a40-4d72-ac71-753479ff06d0', '212881cb-a685-45f8-915b-6e59c9ffbdac', 'be9167ae-e671-4ca1-b814-d6b01ef0b236'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:26 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 1073741824" returned: 0 in 0.710s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:26 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:26 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:26 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 Jul 15 18:37:26 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:26 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.297s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:26 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Deleted volume successfully. Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e9bed599-765d-4774-9b0e-9f6a68a84613 tempest-VolumesActionsTest-811256345 None] Lock "cinder-c1d684ce-ac23-4a4a-abc8-d97c3e397023-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:26 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1" returned: 0 in 0.375s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Attempting download of 58cd658a-6d16-40ff-85de-7b9a03ec1256 ((None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}])) to volume 2fad8d7d-da45-4c75-bc90-b8d22a37d3d1. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafa29a6-b7a5-4a56-b2ab-8877119971a1]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_zzr04nt2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:27 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_zzr04nt2 Jul 15 18:37:27 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:27 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_zzr04nt2" returned: 0 in 0.377s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_zzr04nt2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:27 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_zzr04nt2 Jul 15 18:37:27 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Flow 'volume_create_manager' (46cf5c24-e402-4554-9159-bc69ea0e4479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c07d244-b9b6-44b8-bfb8-45709b688900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c07d244-b9b6-44b8-bfb8-45709b688900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-145850755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc59a81-6965-40c5-bd37-e707a9374d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131ad8dbe81446f3b3dadc05c1ec9207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:27Z,use_quota=True,user_id='46fd866996e14c53acd8979977d907e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919d1855-7816-4047-8009-1ce473202787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919d1855-7816-4047-8009-1ce473202787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d5ec1c-79a7-494c-b9f3-09532fa5a282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d5ec1c-79a7-494c-b9f3-09532fa5a282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc59a81-6965-40c5-bd37-e707a9374d92', 'volume_name': 'volume-4fc59a81-6965-40c5-bd37-e707a9374d92', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00941133-2528-4860-bf02-5b4e63766f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00941133-2528-4860-bf02-5b4e63766f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8524c560-0e60-4d8f-a1dc-40157a7c735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:27 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Volume 4fc59a81-6965-40c5-bd37-e707a9374d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc59a81-6965-40c5-bd37-e707a9374d92', 'volume_size': 1} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-145850755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc59a81-6965-40c5-bd37-e707a9374d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131ad8dbe81446f3b3dadc05c1ec9207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:27Z,use_quota=True,user_id='46fd866996e14c53acd8979977d907e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Creating volume 4fc59a81-6965-40c5-bd37-e707a9374d92 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:27 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4fc59a81-6965-40c5-bd37-e707a9374d92 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:27 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4fc59a81-6965-40c5-bd37-e707a9374d92 1073741824 Jul 15 18:37:27 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:27 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_zzr04nt2" returned: 1 in 0.530s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_zzr04nt2' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[47801379-3f8d-40e3-9f4f-1880367c8151]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:27 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD Jul 15 18:37:27 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:28 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4fc59a81-6965-40c5-bd37-e707a9374d92 1073741824" returned: 0 in 0.565s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:28 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Flow 'volume_create_manager' (c10f458b-88b7-4116-852e-5fad8232a2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c02e4f-7465-4035-8498-e2cf396ba48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4fc59a81-6965-40c5-bd37-e707a9374d92 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] 58cd658a-6d16-40ff-85de-7b9a03ec1256 was qcow2, converting to raw {{(pid=87217) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:28 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4fc59a81-6965-40c5-bd37-e707a9374d92 Jul 15 18:37:28 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c02e4f-7465-4035-8498-e2cf396ba48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-435322502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdaee962-8d7d-4af0-a97c-74b4d0483c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaf53ec462549789598607706607008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:28Z,use_quota=True,user_id='69fc804bd91a4c0996bd1b2ee34fcf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f6246b-99ee-4416-926c-b1d3ed1a8a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f6246b-99ee-4416-926c-b1d3ed1a8a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:28 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 Jul 15 18:37:28 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23fd9cc-bdea-46d9-b261-3ad6a3cf33c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23fd9cc-bdea-46d9-b261-3ad6a3cf33c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdaee962-8d7d-4af0-a97c-74b4d0483c31', 'volume_name': 'volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be956b7-952b-426a-9f9b-94a5b1a6c4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be956b7-952b-426a-9f9b-94a5b1a6c4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e127b1f8-616c-4599-91ba-5b1040c52dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:28 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Volume fdaee962-8d7d-4af0-a97c-74b4d0483c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31', 'volume_size': 1} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:28 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4fc59a81-6965-40c5-bd37-e707a9374d92" returned: 0 in 0.304s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.214s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-435322502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdaee962-8d7d-4af0-a97c-74b4d0483c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaf53ec462549789598607706607008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:28Z,use_quota=True,user_id='69fc804bd91a4c0996bd1b2ee34fcf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Creating volume fdaee962-8d7d-4af0-a97c-74b4d0483c31 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:28 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8524c560-0e60-4d8f-a1dc-40157a7c735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc59a81-6965-40c5-bd37-e707a9374d92', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:28 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31 1073741824 Jul 15 18:37:28 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3da7646-261b-452b-bd11-07d479cdadf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:28 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Volume volume-4fc59a81-6965-40c5-bd37-e707a9374d92 (4fc59a81-6965-40c5-bd37-e707a9374d92): created successfully Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3da7646-261b-452b-bd11-07d479cdadf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Flow 'volume_create_manager' (46cf5c24-e402-4554-9159-bc69ea0e4479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:28 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-531bbd31-b48e-4105-94c4-576ac1ea363e tempest-VolumesTransfersV355Test-2107838590 None] Created volume successfully. Jul 15 18:37:29 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31 1073741824" returned: 0 in 0.623s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:29 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31 Jul 15 18:37:29 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:29 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31" returned: 0 in 0.315s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e127b1f8-616c-4599-91ba-5b1040c52dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b07f89a-2c49-42e3-86a1-31ff4ea9a153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:29 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Volume volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31 (fdaee962-8d7d-4af0-a97c-74b4d0483c31): created successfully Jul 15 18:37:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b07f89a-2c49-42e3-86a1-31ff4ea9a153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Flow 'volume_create_manager' (c10f458b-88b7-4116-852e-5fad8232a2ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:29 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-610aaada-9cf3-4255-ac78-7ddedbb5026b tempest-VolumesActionsTest-975804044 None] Created volume successfully. Jul 15 18:37:30 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1" returned: 0 in 1.884s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:30 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_ajxk0ygfdevstack@QuobyteHD, size 112.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:37:30 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Converted 112.00 MB image at 59.41 MB/s Jul 15 18:37:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:30 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 1G Jul 15 18:37:30 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-74245ef8-5c9a-405f-87a9-081dc9fb82c9 tempest-VolumesTransfersV355Test-145059122 None] Transfer volume completed successfully. Jul 15 18:37:30 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Acquiring lock "cinder-fdaee962-8d7d-4af0-a97c-74b4d0483c31-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 1G" returned: 0 in 0.418s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Lock "cinder-fdaee962-8d7d-4af0-a97c-74b4d0483c31-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:30 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6209dad4-7a8e-4b16-8da3-8d75b72ac448]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Acquiring lock "cinder-quobyte-fdaee962-8d7d-4af0-a97c-74b4d0483c31" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Lock "cinder-quobyte-fdaee962-8d7d-4af0-a97c-74b4d0483c31" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:30 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5355c08-cb6e-4ae7-9b3e-6abbc7068692]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:30 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 Jul 15 18:37:30 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:30 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31 Jul 15 18:37:30 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Acquiring lock "cinder-4fc59a81-6965-40c5-bd37-e707a9374d92-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Lock "cinder-4fc59a81-6965-40c5-bd37-e707a9374d92-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:31 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1" returned: 0 in 0.548s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Acquiring lock "cinder-quobyte-4fc59a81-6965-40c5-bd37-e707a9374d92" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Lock "cinder-quobyte-4fc59a81-6965-40c5-bd37-e707a9374d92" acquired by "delete_volume" :: waited 0.027s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[348e21be-4e1b-48f5-9dac-e9916053b25b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4fc59a81-6965-40c5-bd37-e707a9374d92 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:31 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:31 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 Jul 15 18:37:31 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31" returned: 0 in 0.569s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:31 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31 Jul 15 18:37:31 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:31 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4fc59a81-6965-40c5-bd37-e707a9374d92 Jul 15 18:37:31 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:31 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1" returned: 1 in 0.452s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Downloaded image 58cd658a-6d16-40ff-85de-7b9a03ec1256 ((None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}])) to volume 2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 successfully. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Temporary image 58cd658a-6d16-40ff-85de-7b9a03ec1256 for user d23f5666db0147cbbee49d73101b4336 is deleted. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Marking volume 2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 as bootable. {{(pid=87217) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:37:31 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fdaee962-8d7d-4af0-a97c-74b4d0483c31" returned: 0 in 0.353s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Lock "cinder-quobyte-fdaee962-8d7d-4af0-a97c-74b4d0483c31" released by "delete_volume" :: held 0.998s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Copying metadata from image 58cd658a-6d16-40ff-85de-7b9a03ec1256 to 2fad8d7d-da45-4c75-bc90-b8d22a37d3d1. {{(pid=87217) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Creating volume glance metadata for volume 2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 backed by image 58cd658a-6d16-40ff-85de-7b9a03ec1256 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87217) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:37:31 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4fc59a81-6965-40c5-bd37-e707a9374d92" returned: 0 in 0.467s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4fc59a81-6965-40c5-bd37-e707a9374d92 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:31 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4fc59a81-6965-40c5-bd37-e707a9374d92 Jul 15 18:37:31 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Created reservations ['7a472d65-8bbb-4b21-98f5-d14b7fb81726', 'f872d2ce-fe8f-4c87-b915-f3d037186e98', '63bf9541-0bb3-4b7f-90c6-6e3c3518924f', 'c183772d-ea31-4636-93b0-9bb182ea04d3'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d44d768-ac04-4534-835d-ffadbeca0179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1', 'volume_size': 1, 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1cc7d7f865b4961944a3804db21f9fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'created_at': datetime.datetime(2026, 7, 15, 16, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58cd658a-6d16-40ff-85de-7b9a03ec1256/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17256795-c152-45b4-a7aa-3d54b087e874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:32 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Volume volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 (2fad8d7d-da45-4c75-bc90-b8d22a37d3d1): created successfully Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17256795-c152-45b4-a7aa-3d54b087e874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (f2b4d9e1-6537-436c-9eff-3ea882ad6e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:32 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-085a2b69-a073-4c8d-8cd5-b498bb1d549a tempest-VolumesGetTest-155834816 None] Created volume successfully. Jul 15 18:37:32 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:32 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:32 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4fc59a81-6965-40c5-bd37-e707a9374d92" returned: 0 in 0.278s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Lock "cinder-quobyte-4fc59a81-6965-40c5-bd37-e707a9374d92" released by "delete_volume" :: held 0.799s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Created reservations ['6fd8af87-b3b5-4a38-83da-f5947e6f8487', 'fefbd993-55af-4b0d-ad1c-d572192472da', '70ca9937-d12f-43dd-a3f5-27a0a7ffda74', '9147f5f3-b00f-4286-839d-1d3523fdea71'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:32 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:32 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:32 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.346s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:32 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Deleted volume successfully. Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-01de0a6d-4d74-4e71-81a0-58c80375a589 tempest-VolumesActionsTest-811256345 None] Lock "cinder-fdaee962-8d7d-4af0-a97c-74b4d0483c31-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:32 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.335s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:32 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Deleted volume successfully. Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:32 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-715c7663-5173-4da0-89ef-4a1b1de2b8cf tempest-VolumesTransfersV355Test-772170548 None] Lock "cinder-4fc59a81-6965-40c5-bd37-e707a9374d92-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:32 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:33 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.371s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Flow 'volume_create_manager' (faf09bbc-94b5-484e-a2d6-9ec87aa0cd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c044a7b6-4765-42f2-8725-e092e7c2f70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c044a7b6-4765-42f2-8725-e092e7c2f70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1430672537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79232e65-ac83-4c04-b11e-b78446d2c7fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131ad8dbe81446f3b3dadc05c1ec9207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:33Z,use_quota=True,user_id='46fd866996e14c53acd8979977d907e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e09ad28-2b81-4b14-b114-21d67e522106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e09ad28-2b81-4b14-b114-21d67e522106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb797a0-90b6-48df-a6e3-7632d3cf7791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb797a0-90b6-48df-a6e3-7632d3cf7791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79232e65-ac83-4c04-b11e-b78446d2c7fd', 'volume_name': 'volume-79232e65-ac83-4c04-b11e-b78446d2c7fd', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd44978-8765-48da-865d-6922ace0b910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd44978-8765-48da-865d-6922ace0b910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dbd19c-f89d-4d20-91a1-c40eed6e98a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:33 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Volume 79232e65-ac83-4c04-b11e-b78446d2c7fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79232e65-ac83-4c04-b11e-b78446d2c7fd', 'volume_size': 1} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1430672537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79232e65-ac83-4c04-b11e-b78446d2c7fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131ad8dbe81446f3b3dadc05c1ec9207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:33Z,use_quota=True,user_id='46fd866996e14c53acd8979977d907e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Creating volume 79232e65-ac83-4c04-b11e-b78446d2c7fd {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:33 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-79232e65-ac83-4c04-b11e-b78446d2c7fd 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:33 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-79232e65-ac83-4c04-b11e-b78446d2c7fd 1073741824 Jul 15 18:37:33 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Flow 'volume_create_manager' (841156ef-11c8-4090-a018-b0025ab547f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017eb497-879d-4e40-9711-e90e2d0390db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017eb497-879d-4e40-9711-e90e2d0390db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1919475194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aaa9d37-1489-4aca-a8e6-2b46120207fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaf53ec462549789598607706607008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:34Z,use_quota=True,user_id='69fc804bd91a4c0996bd1b2ee34fcf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23f3bcb-f3ea-46cb-b581-7bfed080ff44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23f3bcb-f3ea-46cb-b581-7bfed080ff44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef54c4ea-7b5c-4f68-831a-8b80c36f3c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef54c4ea-7b5c-4f68-831a-8b80c36f3c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aaa9d37-1489-4aca-a8e6-2b46120207fd', 'volume_name': 'volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b891e5-ec5c-4e73-87d7-2e0ea79f14f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b891e5-ec5c-4e73-87d7-2e0ea79f14f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27abd356-fd42-446a-9a85-c4bed0f1b8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:34 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Volume 6aaa9d37-1489-4aca-a8e6-2b46120207fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd', 'volume_size': 1} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:34 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-79232e65-ac83-4c04-b11e-b78446d2c7fd 1073741824" returned: 0 in 0.918s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-79232e65-ac83-4c04-b11e-b78446d2c7fd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:34 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-79232e65-ac83-4c04-b11e-b78446d2c7fd Jul 15 18:37:34 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (a3ea858d-09bb-45dd-abcd-66ce25a3d2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9906756-777c-435f-8338-1b5aeb6aadee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9906756-777c-435f-8338-1b5aeb6aadee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2085955617',display_name='tempest-VolumesGetTest-Volume-1253941325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4300b7f7-e109-4393-9a83-cae41592bf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:34Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a91f53-c991-4297-89cf-051b88ddd018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a91f53-c991-4297-89cf-051b88ddd018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d487490-bca1-4f1d-b08a-1a64cb641711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d487490-bca1-4f1d-b08a-1a64cb641711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4300b7f7-e109-4393-9a83-cae41592bf1c', 'volume_name': 'volume-4300b7f7-e109-4393-9a83-cae41592bf1c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db9c255-0459-4e99-8556-8de9ec934e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db9c255-0459-4e99-8556-8de9ec934e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c08f7d4-9f2f-438c-9df3-62a56e60a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:34 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Volume 4300b7f7-e109-4393-9a83-cae41592bf1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4300b7f7-e109-4393-9a83-cae41592bf1c', 'volume_size': 1} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:34 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-79232e65-ac83-4c04-b11e-b78446d2c7fd" returned: 0 in 0.444s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1919475194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aaa9d37-1489-4aca-a8e6-2b46120207fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaf53ec462549789598607706607008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:34Z,use_quota=True,user_id='69fc804bd91a4c0996bd1b2ee34fcf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Creating volume 6aaa9d37-1489-4aca-a8e6-2b46120207fd {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:34 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:34 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd 1073741824 Jul 15 18:37:34 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dbd19c-f89d-4d20-91a1-c40eed6e98a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79232e65-ac83-4c04-b11e-b78446d2c7fd', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ebe6f9-d15e-4065-ae0c-25b68e720b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:34 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Volume volume-79232e65-ac83-4c04-b11e-b78446d2c7fd (79232e65-ac83-4c04-b11e-b78446d2c7fd): created successfully Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ebe6f9-d15e-4065-ae0c-25b68e720b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Flow 'volume_create_manager' (faf09bbc-94b5-484e-a2d6-9ec87aa0cd7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:34 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1a5a4c3e-7f92-455a-8146-342bc0c23a4e tempest-VolumesTransfersV355Test-2107838590 None] Created volume successfully. Jul 15 18:37:35 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd 1073741824" returned: 0 in 0.586s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:35 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd Jul 15 18:37:35 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Acquiring lock "cinder-79232e65-ac83-4c04-b11e-b78446d2c7fd-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Lock "cinder-79232e65-ac83-4c04-b11e-b78446d2c7fd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Acquiring lock "cinder-quobyte-79232e65-ac83-4c04-b11e-b78446d2c7fd" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Lock "cinder-quobyte-79232e65-ac83-4c04-b11e-b78446d2c7fd" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e86e92d-fee9-42d7-a9ff-75b925aa7efb]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-79232e65-ac83-4c04-b11e-b78446d2c7fd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:35 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd" returned: 0 in 0.290s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.046s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2085955617',display_name='tempest-VolumesGetTest-Volume-1253941325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4300b7f7-e109-4393-9a83-cae41592bf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e598fde93a7e490f843b00aa401fe2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:34Z,use_quota=True,user_id='d23f5666db0147cbbee49d73101b4336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Creating volume 4300b7f7-e109-4393-9a83-cae41592bf1c {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:35 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4300b7f7-e109-4393-9a83-cae41592bf1c 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:35 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-79232e65-ac83-4c04-b11e-b78446d2c7fd Jul 15 18:37:35 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:35 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4300b7f7-e109-4393-9a83-cae41592bf1c 1073741824 Jul 15 18:37:35 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27abd356-fd42-446a-9a85-c4bed0f1b8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99990c22-e6ec-42b5-9fd3-411b11fe5286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:35 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Volume volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd (6aaa9d37-1489-4aca-a8e6-2b46120207fd): created successfully Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99990c22-e6ec-42b5-9fd3-411b11fe5286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Flow 'volume_create_manager' (841156ef-11c8-4090-a018-b0025ab547f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:35 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-373f08b9-9138-4d82-9462-512d913bf1cf tempest-VolumesActionsTest-975804044 None] Created volume successfully. Jul 15 18:37:36 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-79232e65-ac83-4c04-b11e-b78446d2c7fd" returned: 0 in 0.442s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-79232e65-ac83-4c04-b11e-b78446d2c7fd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:36 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-79232e65-ac83-4c04-b11e-b78446d2c7fd Jul 15 18:37:36 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Acquiring lock "cinder-6aaa9d37-1489-4aca-a8e6-2b46120207fd-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Lock "cinder-6aaa9d37-1489-4aca-a8e6-2b46120207fd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Acquiring lock "cinder-quobyte-6aaa9d37-1489-4aca-a8e6-2b46120207fd" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Lock "cinder-quobyte-6aaa9d37-1489-4aca-a8e6-2b46120207fd" acquired by "delete_volume" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:36 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4300b7f7-e109-4393-9a83-cae41592bf1c 1073741824" returned: 0 in 0.669s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a845e6-6638-43a9-91c1-37f1a60b245c]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4300b7f7-e109-4393-9a83-cae41592bf1c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:36 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4300b7f7-e109-4393-9a83-cae41592bf1c Jul 15 18:37:36 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:36 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-79232e65-ac83-4c04-b11e-b78446d2c7fd" returned: 0 in 0.449s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Lock "cinder-quobyte-79232e65-ac83-4c04-b11e-b78446d2c7fd" released by "delete_volume" :: held 0.940s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:36 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd Jul 15 18:37:36 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Created reservations ['8d595a96-ae92-43a9-bf5d-f0a702dfb2e1', 'ed401a81-8030-4aa6-85ee-f29ae0aa694d', 'a958853e-3a67-497f-9860-383286d974d4', '6e27a99b-bb44-4df6-bfb4-c220fc55f908'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:36 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:36 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:36 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4300b7f7-e109-4393-9a83-cae41592bf1c" returned: 0 in 0.357s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c08f7d4-9f2f-438c-9df3-62a56e60a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4300b7f7-e109-4393-9a83-cae41592bf1c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25ff36e-2c2f-4103-8eef-80683fb9999f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:36 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Volume volume-4300b7f7-e109-4393-9a83-cae41592bf1c (4300b7f7-e109-4393-9a83-cae41592bf1c): created successfully Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25ff36e-2c2f-4103-8eef-80683fb9999f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Flow 'volume_create_manager' (a3ea858d-09bb-45dd-abcd-66ce25a3d2dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:36 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-23544c8c-d1a7-4cba-b473-45a383dcaf52 tempest-VolumesGetTest-155834816 None] Created volume successfully. Jul 15 18:37:37 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd" returned: 0 in 0.554s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:37 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd Jul 15 18:37:37 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:37 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.530s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:37 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Deleted volume successfully. Jul 15 18:37:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ea63e0cd-21b0-4b6e-941c-3d5e7c7dc650 tempest-VolumesTransfersV355Test-772170548 None] Lock "cinder-79232e65-ac83-4c04-b11e-b78446d2c7fd-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:37 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6aaa9d37-1489-4aca-a8e6-2b46120207fd" returned: 0 in 0.679s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Lock "cinder-quobyte-6aaa9d37-1489-4aca-a8e6-2b46120207fd" released by "delete_volume" :: held 1.300s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:37 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Created reservations ['5e463a35-09ac-4102-bdcf-4efc1dacaa96', '5f29bd6d-53b6-4e88-aefb-cecc55212aeb', 'bc8945a3-03f3-4439-979f-d9f0e89b1865', '2430685b-b611-4224-b3e4-78eacf3a60ce'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:38 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:38 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-4300b7f7-e109-4393-9a83-cae41592bf1c-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Lock "cinder-4300b7f7-e109-4393-9a83-cae41592bf1c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-quobyte-4300b7f7-e109-4393-9a83-cae41592bf1c" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-4300b7f7-e109-4393-9a83-cae41592bf1c" acquired by "delete_volume" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[461a65d9-a16b-4dfa-9a1d-f23432e4cbec]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4300b7f7-e109-4393-9a83-cae41592bf1c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:38 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.472s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:38 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Deleted volume successfully. Jul 15 18:37:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4939cce1-c9ea-4816-a711-2b3098efd188 tempest-VolumesActionsTest-811256345 None] Lock "cinder-6aaa9d37-1489-4aca-a8e6-2b46120207fd-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:38 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4300b7f7-e109-4393-9a83-cae41592bf1c Jul 15 18:37:38 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:39 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4300b7f7-e109-4393-9a83-cae41592bf1c" returned: 0 in 0.595s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4300b7f7-e109-4393-9a83-cae41592bf1c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:39 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4300b7f7-e109-4393-9a83-cae41592bf1c Jul 15 18:37:39 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:39 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4300b7f7-e109-4393-9a83-cae41592bf1c" returned: 0 in 0.386s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-4300b7f7-e109-4393-9a83-cae41592bf1c" released by "delete_volume" :: held 1.049s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Created reservations ['a16ded29-433b-439c-ae94-7252c431415f', '87f59fac-4f45-47d2-b83c-a8d34d290f4f', '0af28267-980f-4a91-90b8-bbae3aa2276f', '4cda9c24-bfc2-48a9-a293-330576686f97'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:39 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:39 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Flow 'volume_create_manager' (ac42aac0-7629-4021-b8a9-ca4f2aa629ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17761a23-b9bb-4ad6-87d5-1c503aa00618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17761a23-b9bb-4ad6-87d5-1c503aa00618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1543667518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a61941a-4d3b-4f74-b06d-4f9885622522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaf53ec462549789598607706607008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:40Z,use_quota=True,user_id='69fc804bd91a4c0996bd1b2ee34fcf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656afd21-cf63-4bbc-8279-f5c1c709d28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656afd21-cf63-4bbc-8279-f5c1c709d28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330c068f-ec50-4019-8ddb-e5e785b3acdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330c068f-ec50-4019-8ddb-e5e785b3acdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a61941a-4d3b-4f74-b06d-4f9885622522', 'volume_name': 'volume-9a61941a-4d3b-4f74-b06d-4f9885622522', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f01558-68a0-4fa9-962e-8c472e9bc0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f01558-68a0-4fa9-962e-8c472e9bc0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fa1e0e-913f-45d1-90a0-da898037e028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:40 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Volume 9a61941a-4d3b-4f74-b06d-4f9885622522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a61941a-4d3b-4f74-b06d-4f9885622522', 'volume_size': 1} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1543667518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a61941a-4d3b-4f74-b06d-4f9885622522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaf53ec462549789598607706607008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:40Z,use_quota=True,user_id='69fc804bd91a4c0996bd1b2ee34fcf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Creating volume 9a61941a-4d3b-4f74-b06d-4f9885622522 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:40 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a61941a-4d3b-4f74-b06d-4f9885622522 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:40 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a61941a-4d3b-4f74-b06d-4f9885622522 1073741824 Jul 15 18:37:40 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:40 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.433s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:40 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Deleted volume successfully. Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-090e2db9-bb50-48e5-ae16-bde06b76999d tempest-VolumesGetTest-155834816 None] Lock "cinder-4300b7f7-e109-4393-9a83-cae41592bf1c-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:40 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a61941a-4d3b-4f74-b06d-4f9885622522 1073741824" returned: 0 in 0.792s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Lock "cinder-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a61941a-4d3b-4f74-b06d-4f9885622522 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:41 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a61941a-4d3b-4f74-b06d-4f9885622522 Jul 15 18:37:41 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Acquiring lock "cinder-quobyte-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1" acquired by "delete_volume" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[054de22c-cce2-45f0-8bbb-a356924daeae]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:41 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:41 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 Jul 15 18:37:41 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a61941a-4d3b-4f74-b06d-4f9885622522" returned: 0 in 0.364s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fa1e0e-913f-45d1-90a0-da898037e028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a61941a-4d3b-4f74-b06d-4f9885622522', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca6c092-ff62-4365-ace1-138f059a13f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:41 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Volume volume-9a61941a-4d3b-4f74-b06d-4f9885622522 (9a61941a-4d3b-4f74-b06d-4f9885622522): created successfully Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca6c092-ff62-4365-ace1-138f059a13f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Flow 'volume_create_manager' (ac42aac0-7629-4021-b8a9-ca4f2aa629ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:41 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-3fd16fb4-be2e-4a4a-a0b7-32f0a5d7ec6f tempest-VolumesActionsTest-975804044 None] Created volume successfully. Jul 15 18:37:41 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1" returned: 0 in 0.478s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:41 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 Jul 15 18:37:41 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:42 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1" returned: 1 in 0.735s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:37:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Acquiring lock "cinder-9a61941a-4d3b-4f74-b06d-4f9885622522-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:42 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1 Jul 15 18:37:42 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Lock "cinder-9a61941a-4d3b-4f74-b06d-4f9885622522-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Acquiring lock "cinder-quobyte-9a61941a-4d3b-4f74-b06d-4f9885622522" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Lock "cinder-quobyte-9a61941a-4d3b-4f74-b06d-4f9885622522" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:42 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22d4281-ff37-4d87-b762-ada6fbfba742]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a61941a-4d3b-4f74-b06d-4f9885622522 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:42 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1" returned: 0 in 0.398s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Lock "cinder-quobyte-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1" released by "delete_volume" :: held 1.734s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:42 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a61941a-4d3b-4f74-b06d-4f9885622522 Jul 15 18:37:42 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:43 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Created reservations ['369bcf71-f23f-4c30-8864-87fbad2ddb30', 'b3f24e87-146e-405b-9f12-30d4aa356ef5', 'a97f40d0-1d58-4c90-903c-686c989dda6e', '1a50a645-e9a8-4c88-a3cc-cc31c7b5ad76'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:43 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:43 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:43 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a61941a-4d3b-4f74-b06d-4f9885622522" returned: 0 in 0.732s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a61941a-4d3b-4f74-b06d-4f9885622522 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:43 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a61941a-4d3b-4f74-b06d-4f9885622522 Jul 15 18:37:43 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:43 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.619s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:43 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:43 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Deleted volume successfully. Jul 15 18:37:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c8d19a65-ab61-46ee-b03e-93ed51d566b5 tempest-VolumesGetTest-155834816 None] Lock "cinder-2fad8d7d-da45-4c75-bc90-b8d22a37d3d1-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:44 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9a61941a-4d3b-4f74-b06d-4f9885622522" returned: 0 in 0.571s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Lock "cinder-quobyte-9a61941a-4d3b-4f74-b06d-4f9885622522" released by "delete_volume" :: held 1.391s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:44 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Created reservations ['45db003f-5919-40e4-afa8-1980d84355f9', 'af32f5ed-9818-40ec-b165-097e652e0e10', 'beded8e7-ba5b-45a8-90fd-c40ce7dfe843', '89405cf7-d81e-4a2f-9061-f205b17dd2cd'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:44 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:44 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:44 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.379s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:44 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:44 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Deleted volume successfully. Jul 15 18:37:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-24571d1a-8d7d-4fad-953c-a54f2435deee tempest-VolumesActionsTest-811256345 None] Lock "cinder-9a61941a-4d3b-4f74-b06d-4f9885622522-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Flow 'volume_create_manager' (9650846a-3c01-46bc-9419-cc5956c1bfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b60a05-a18a-47bf-b906-a9670a3d3830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b60a05-a18a-47bf-b906-a9670a3d3830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2058569303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939017e9-62e0-4785-909b-6f602fc70441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaf53ec462549789598607706607008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:46Z,use_quota=True,user_id='69fc804bd91a4c0996bd1b2ee34fcf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c606bc-e864-438f-a5bf-3bd052d62c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c606bc-e864-438f-a5bf-3bd052d62c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee476540-0e95-4dc6-81dc-71f59526e0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee476540-0e95-4dc6-81dc-71f59526e0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '939017e9-62e0-4785-909b-6f602fc70441', 'volume_name': 'volume-939017e9-62e0-4785-909b-6f602fc70441', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75218274-cfdb-41d3-a1ad-bdd8299eba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75218274-cfdb-41d3-a1ad-bdd8299eba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8854d4-2a82-48c7-a3ae-3b371cbcfca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:45 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Volume 939017e9-62e0-4785-909b-6f602fc70441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-939017e9-62e0-4785-909b-6f602fc70441', 'volume_size': 1} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2058569303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939017e9-62e0-4785-909b-6f602fc70441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaf53ec462549789598607706607008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:46Z,use_quota=True,user_id='69fc804bd91a4c0996bd1b2ee34fcf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Creating volume 939017e9-62e0-4785-909b-6f602fc70441 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:45 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-939017e9-62e0-4785-909b-6f602fc70441 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:45 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-939017e9-62e0-4785-909b-6f602fc70441 1073741824 Jul 15 18:37:45 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:46 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-939017e9-62e0-4785-909b-6f602fc70441 1073741824" returned: 0 in 0.651s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-939017e9-62e0-4785-909b-6f602fc70441 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:46 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-939017e9-62e0-4785-909b-6f602fc70441 Jul 15 18:37:46 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:46 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-939017e9-62e0-4785-909b-6f602fc70441" returned: 0 in 0.389s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8854d4-2a82-48c7-a3ae-3b371cbcfca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-939017e9-62e0-4785-909b-6f602fc70441', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abc7efe-d46e-42a4-aa54-b411f29ae53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:46 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Volume volume-939017e9-62e0-4785-909b-6f602fc70441 (939017e9-62e0-4785-909b-6f602fc70441): created successfully Jul 15 18:37:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abc7efe-d46e-42a4-aa54-b411f29ae53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Flow 'volume_create_manager' (9650846a-3c01-46bc-9419-cc5956c1bfb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:46 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-bd3a93f7-20e2-4938-96ff-9ffde3c269f6 tempest-VolumesActionsTest-975804044 None] Created volume successfully. Jul 15 18:37:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Acquiring lock "cinder-939017e9-62e0-4785-909b-6f602fc70441-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Lock "cinder-939017e9-62e0-4785-909b-6f602fc70441-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Acquiring lock "cinder-quobyte-939017e9-62e0-4785-909b-6f602fc70441" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:37:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Lock "cinder-quobyte-939017e9-62e0-4785-909b-6f602fc70441" acquired by "delete_volume" :: waited 0.029s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:37:48 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f4c3b8-efe0-473a-915f-290e296ca62a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:37:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-939017e9-62e0-4785-909b-6f602fc70441 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:49 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-939017e9-62e0-4785-909b-6f602fc70441 Jul 15 18:37:49 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:49 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-939017e9-62e0-4785-909b-6f602fc70441" returned: 0 in 0.531s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-939017e9-62e0-4785-909b-6f602fc70441 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:49 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-939017e9-62e0-4785-909b-6f602fc70441 Jul 15 18:37:49 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:49 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-939017e9-62e0-4785-909b-6f602fc70441" returned: 0 in 0.401s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Lock "cinder-quobyte-939017e9-62e0-4785-909b-6f602fc70441" released by "delete_volume" :: held 1.016s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:49 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Created reservations ['1e6c4234-eaaa-4c1c-8d72-1c98b757613f', 'c5dfa839-bd70-4373-b68f-414ddebc9f21', 'c66cf79a-eab9-4d37-962a-a71a03102376', 'e4e8b6ac-3208-4dd0-9f5b-5eed79081be7'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:37:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:50 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:37:50 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:50 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.306s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:50 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:37:50 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Deleted volume successfully. Jul 15 18:37:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-45229362-53f8-4941-8a72-8b22093bf933 tempest-VolumesActionsTest-975804044 None] Lock "cinder-939017e9-62e0-4785-909b-6f602fc70441-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Flow 'volume_create_manager' (fb9d1b7e-a83c-4f58-9b79-7c6b4900ef37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbf6f78-f46b-4646-b050-40f70a2fc32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbf6f78-f46b-4646-b050-40f70a2fc32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1246937125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0937dac-0eab-4fb2-88b5-e820141fb3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6a41b24e6e41a7932be28e910e21e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:51Z,use_quota=True,user_id='076df69d53294a48bb94e85e6823b83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f89b92-10c6-4dda-9e9b-3d051a360432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f89b92-10c6-4dda-9e9b-3d051a360432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62dba6e-b8c0-4773-9ed5-472d571d489f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62dba6e-b8c0-4773-9ed5-472d571d489f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0937dac-0eab-4fb2-88b5-e820141fb3c7', 'volume_name': 'volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e705e0-5aec-4ed4-889d-e8704dd48d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e705e0-5aec-4ed4-889d-e8704dd48d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262b6dd7-9c87-46ef-9bb9-d61a89fc5bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:51 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Volume a0937dac-0eab-4fb2-88b5-e820141fb3c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7', 'volume_size': 1} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1246937125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0937dac-0eab-4fb2-88b5-e820141fb3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6a41b24e6e41a7932be28e910e21e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:37:51Z,use_quota=True,user_id='076df69d53294a48bb94e85e6823b83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Creating volume a0937dac-0eab-4fb2-88b5-e820141fb3c7 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:37:51 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:37:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:51 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7 1073741824 Jul 15 18:37:51 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:52 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7 1073741824" returned: 0 in 0.560s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:37:52 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7 Jul 15 18:37:52 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:37:52 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 15 18:37:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7" returned: 0 in 0.250s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:37:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:37:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:37:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262b6dd7-9c87-46ef-9bb9-d61a89fc5bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9387ad-8e8f-457b-ad51-d36366b63783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:37:52 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Volume volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7 (a0937dac-0eab-4fb2-88b5-e820141fb3c7): created successfully Jul 15 18:37:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9387ad-8e8f-457b-ad51-d36366b63783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:37:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Flow 'volume_create_manager' (fb9d1b7e-a83c-4f58-9b79-7c6b4900ef37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:37:52 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-45cb8afe-aa1d-4ca5-acf3-f90a7bb6b002 tempest-VolumesNegativeTest-861447261 None] Created volume successfully. Jul 15 18:38:02 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=163,cinder:SELECT=115,cinder:DELETE=12,cinder:INSERT=44 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:38:02 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=124,cinder:UPDATE=165,cinder:INSERT=42,cinder:DELETE=17 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:38:11 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-ae9d50b1-d962-4df2-83af-a1dc3c570b48 req-1188269d-c107-4395-bd20-92655f867ac1 tempest-AttachVolumeNegativeTest-1381542441 None] Terminate volume connection completed successfully. Jul 15 18:38:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-ae9d50b1-d962-4df2-83af-a1dc3c570b48 req-1188269d-c107-4395-bd20-92655f867ac1 tempest-AttachVolumeNegativeTest-1381542441 None] Deleting attachment e05d90e1-c804-47a9-8946-879ed1b48edd. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Flow 'volume_create_manager' (3d76ac9a-ca76-485e-95b2-f76356f354db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9db850-5510-4210-b2b3-99350d3ccf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9db850-5510-4210-b2b3-99350d3ccf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1455562825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e7b455-a1c4-44c0-9615-91dd3b0af119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257b7a151e2d4c77a86d0b975ae10fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:14Z,use_quota=True,user_id='c8e33dc4a74f430bb4461b5dfb8d0c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b6610a-42de-40f5-b842-568283767d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b6610a-42de-40f5-b842-568283767d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60fa890a-8650-4edb-851f-237f58ad5ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60fa890a-8650-4edb-851f-237f58ad5ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5e7b455-a1c4-44c0-9615-91dd3b0af119', 'volume_name': 'volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342c1ff4-809c-473e-a5e3-8dce92373e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342c1ff4-809c-473e-a5e3-8dce92373e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e77d005-1aff-4a91-b100-9aa57e6a6ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:14 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Volume f5e7b455-a1c4-44c0-9615-91dd3b0af119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119', 'volume_size': 1} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1455562825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e7b455-a1c4-44c0-9615-91dd3b0af119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257b7a151e2d4c77a86d0b975ae10fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:14Z,use_quota=True,user_id='c8e33dc4a74f430bb4461b5dfb8d0c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Creating volume f5e7b455-a1c4-44c0-9615-91dd3b0af119 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:14 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:38:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:14 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119 1073741824 Jul 15 18:38:14 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:15 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119 1073741824" returned: 0 in 0.638s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:15 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119 Jul 15 18:38:15 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:15 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119" returned: 0 in 0.378s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e77d005-1aff-4a91-b100-9aa57e6a6ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdaec4ed-18e9-4e6f-b99c-26d2793d12c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:15 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Volume volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119 (f5e7b455-a1c4-44c0-9615-91dd3b0af119): created successfully Jul 15 18:38:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdaec4ed-18e9-4e6f-b99c-26d2793d12c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Flow 'volume_create_manager' (3d76ac9a-ca76-485e-95b2-f76356f354db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:15 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-3fc8340d-7b99-4f98-8787-cd35691b457e tempest-VolumesListAdminTestJSON-1686222196 None] Created volume successfully. Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Flow 'volume_create_manager' (d87717b1-45c0-4bc5-9708-fb7ad6eaf387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587f5d02-1951-4612-b064-11138fb7c4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587f5d02-1951-4612-b064-11138fb7c4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2017821986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18756497-0c82-44d5-9462-22580e4c0dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257b7a151e2d4c77a86d0b975ae10fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:17Z,use_quota=True,user_id='c8e33dc4a74f430bb4461b5dfb8d0c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af30d48-04eb-4d0a-b330-877d7adadbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af30d48-04eb-4d0a-b330-877d7adadbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e9fda4-6885-4b63-9d6a-08d2561de752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e9fda4-6885-4b63-9d6a-08d2561de752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18756497-0c82-44d5-9462-22580e4c0dda', 'volume_name': 'volume-18756497-0c82-44d5-9462-22580e4c0dda', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df7c929-fcbb-471c-a20b-f7fea0632a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df7c929-fcbb-471c-a20b-f7fea0632a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05cc306c-58e6-478d-8364-eb65a0314e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:17 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Volume 18756497-0c82-44d5-9462-22580e4c0dda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18756497-0c82-44d5-9462-22580e4c0dda', 'volume_size': 1} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2017821986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18756497-0c82-44d5-9462-22580e4c0dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257b7a151e2d4c77a86d0b975ae10fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:17Z,use_quota=True,user_id='c8e33dc4a74f430bb4461b5dfb8d0c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Creating volume 18756497-0c82-44d5-9462-22580e4c0dda {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:17 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:38:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-18756497-0c82-44d5-9462-22580e4c0dda 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:17 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-18756497-0c82-44d5-9462-22580e4c0dda 1073741824 Jul 15 18:38:17 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:18 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-18756497-0c82-44d5-9462-22580e4c0dda 1073741824" returned: 0 in 0.725s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-18756497-0c82-44d5-9462-22580e4c0dda {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:18 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-18756497-0c82-44d5-9462-22580e4c0dda Jul 15 18:38:18 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:18 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-18756497-0c82-44d5-9462-22580e4c0dda" returned: 0 in 0.342s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05cc306c-58e6-478d-8364-eb65a0314e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18756497-0c82-44d5-9462-22580e4c0dda', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d31ae5-3c0c-4f37-802b-2612a64a2825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:18 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Volume volume-18756497-0c82-44d5-9462-22580e4c0dda (18756497-0c82-44d5-9462-22580e4c0dda): created successfully Jul 15 18:38:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d31ae5-3c0c-4f37-802b-2612a64a2825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Flow 'volume_create_manager' (d87717b1-45c0-4bc5-9708-fb7ad6eaf387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:18 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b32c07e7-d73f-4e68-b60a-274da12d08a3 tempest-VolumesListAdminTestJSON-1686222196 None] Created volume successfully. Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Flow 'volume_create_manager' (2c5b2764-eee8-4341-a227-4422dbb1d5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3623318c-6154-4b47-b996-004831f60bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3623318c-6154-4b47-b996-004831f60bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-850826689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0a2332-21dd-45a3-96cb-9eb1d403bb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257b7a151e2d4c77a86d0b975ae10fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:20Z,use_quota=True,user_id='c8e33dc4a74f430bb4461b5dfb8d0c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a7b647-97c6-4917-b29d-c4370d037fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a7b647-97c6-4917-b29d-c4370d037fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef209a96-5080-4eda-a0cf-84a7c381d1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef209a96-5080-4eda-a0cf-84a7c381d1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b0a2332-21dd-45a3-96cb-9eb1d403bb60', 'volume_name': 'volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52f191e-a1d1-4778-bbe6-5253b53a5478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52f191e-a1d1-4778-bbe6-5253b53a5478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd764aa-d910-40aa-9eea-a0f4d969019a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:20 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Volume 2b0a2332-21dd-45a3-96cb-9eb1d403bb60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60', 'volume_size': 1} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-850826689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0a2332-21dd-45a3-96cb-9eb1d403bb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257b7a151e2d4c77a86d0b975ae10fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:20Z,use_quota=True,user_id='c8e33dc4a74f430bb4461b5dfb8d0c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Creating volume 2b0a2332-21dd-45a3-96cb-9eb1d403bb60 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:20 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:38:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:20 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60 1073741824 Jul 15 18:38:20 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:21 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60 1073741824" returned: 0 in 0.564s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:21 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60 Jul 15 18:38:21 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:21 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60" returned: 0 in 0.326s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd764aa-d910-40aa-9eea-a0f4d969019a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9abffb60-3784-4cc9-bcf8-ab9ceff76188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:21 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Volume volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60 (2b0a2332-21dd-45a3-96cb-9eb1d403bb60): created successfully Jul 15 18:38:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9abffb60-3784-4cc9-bcf8-ab9ceff76188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Flow 'volume_create_manager' (2c5b2764-eee8-4341-a227-4422dbb1d5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:21 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ca1520ec-e0b8-48e7-9d27-2bb72db64791 tempest-VolumesListAdminTestJSON-1686222196 None] Created volume successfully. Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Flow 'volume_create_manager' (60a6983e-350a-440b-8ccf-7ee04530f0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388d5c9a-242e-492a-9949-b6ad7ff6c64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388d5c9a-242e-492a-9949-b6ad7ff6c64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8ea60e-f0d9-4ba2-b737-ed9266a9c088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ad1b7d3b7c4523aaa6a2c42adfabb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:23Z,use_quota=True,user_id='1226d73b59284ac28f4605d65646a83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b246ecac-44f9-46b0-afdd-946bf4c13a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b246ecac-44f9-46b0-afdd-946bf4c13a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265589fb-0bbe-4edc-b49c-13f0917cc4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265589fb-0bbe-4edc-b49c-13f0917cc4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d8ea60e-f0d9-4ba2-b737-ed9266a9c088', 'volume_name': 'volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29609992-80a9-4d69-bd63-de486ddcaf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29609992-80a9-4d69-bd63-de486ddcaf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7339bc-5a33-4b09-bfb7-20b6338e34b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:23 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Volume 8d8ea60e-f0d9-4ba2-b737-ed9266a9c088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088', 'volume_size': 1} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8ea60e-f0d9-4ba2-b737-ed9266a9c088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31ad1b7d3b7c4523aaa6a2c42adfabb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:23Z,use_quota=True,user_id='1226d73b59284ac28f4605d65646a83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Creating volume 8d8ea60e-f0d9-4ba2-b737-ed9266a9c088 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:23 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:38:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:23 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088 1073741824 Jul 15 18:38:23 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:24 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088 1073741824" returned: 0 in 0.597s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:24 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088 Jul 15 18:38:24 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:24 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088" returned: 0 in 0.379s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7339bc-5a33-4b09-bfb7-20b6338e34b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f11d3d4-19e1-4109-9f4d-1d380deeaa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:24 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Volume volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088 (8d8ea60e-f0d9-4ba2-b737-ed9266a9c088): created successfully Jul 15 18:38:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f11d3d4-19e1-4109-9f4d-1d380deeaa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Flow 'volume_create_manager' (60a6983e-350a-440b-8ccf-7ee04530f0e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:24 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-334f8d4c-367b-426a-a021-c63335d06a6b tempest-VolumesListAdminTestJSON-692269236 None] Created volume successfully. Jul 15 18:38:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Acquiring lock "cinder-a0937dac-0eab-4fb2-88b5-e820141fb3c7-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Lock "cinder-a0937dac-0eab-4fb2-88b5-e820141fb3c7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Acquiring lock "cinder-quobyte-a0937dac-0eab-4fb2-88b5-e820141fb3c7" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Lock "cinder-quobyte-a0937dac-0eab-4fb2-88b5-e820141fb3c7" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59a86b1-fa31-4b11-bbc4-f57b09d90675]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:25 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7 Jul 15 18:38:25 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Acquiring lock "cinder-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Lock "cinder-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Acquiring lock "cinder-quobyte-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Lock "cinder-quobyte-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088" acquired by "delete_volume" :: waited 0.043s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[df94ff8d-8c1e-4b3d-ac67-d1cc3001e175]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:25 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7" returned: 0 in 0.761s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "cinder-2b0a2332-21dd-45a3-96cb-9eb1d403bb60-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:25 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7 Jul 15 18:38:25 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Lock "cinder-2b0a2332-21dd-45a3-96cb-9eb1d403bb60-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "cinder-quobyte-2b0a2332-21dd-45a3-96cb-9eb1d403bb60" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Lock "cinder-quobyte-2b0a2332-21dd-45a3-96cb-9eb1d403bb60" acquired by "delete_volume" :: waited 0.033s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:26 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088 Jul 15 18:38:26 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd42fcee-894c-4849-b838-2567d6ae7031]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:26 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60 Jul 15 18:38:26 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:26 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0937dac-0eab-4fb2-88b5-e820141fb3c7" returned: 0 in 0.549s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Lock "cinder-quobyte-a0937dac-0eab-4fb2-88b5-e820141fb3c7" released by "delete_volume" :: held 1.391s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Created reservations ['a79d80a9-3c40-4ab4-99d1-d999465086fc', 'd77d89f7-4759-4208-9526-5ed613d459d9', '013b3dee-ed8e-4e11-840b-50b2b54e72f0', 'c7e7df7c-5b75-4023-948a-6df0c47f7fba'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:26 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:26 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:38:26 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088" returned: 0 in 1.024s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:26 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088 Jul 15 18:38:26 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:26 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60" returned: 0 in 0.729s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:27 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60 Jul 15 18:38:27 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:27 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.546s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:27 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Deleted volume successfully. Jul 15 18:38:27 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-071d54e1-0794-43f2-9ef3-cf6bb4a761b8 tempest-VolumesNegativeTest-861447261 None] Lock "cinder-a0937dac-0eab-4fb2-88b5-e820141fb3c7-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b0a2332-21dd-45a3-96cb-9eb1d403bb60" returned: 0 in 0.415s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Lock "cinder-quobyte-2b0a2332-21dd-45a3-96cb-9eb1d403bb60" released by "delete_volume" :: held 1.264s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:27 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088" returned: 0 in 0.591s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Lock "cinder-quobyte-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088" released by "delete_volume" :: held 1.705s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Created reservations ['7f1dbdc5-94c4-47ec-8fa4-311cc7630d19', '05d68b83-154d-4bf9-8b7b-83686c081e48', '52ca0cff-7546-4828-a678-409ec7687f1f', 'be25962a-5d85-4189-a4b4-0989872d2279'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Created reservations ['78f9b8c0-167f-47ed-bb72-90bffd935970', 'edea39a1-fca2-4dbb-a86a-ae7fc6bb2a0b', 'c5f24d9f-b8dc-4d05-ba84-d44528757dd3', 'f7a24249-6dc3-4bf8-ad86-5bc99e15360b'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:27 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:38:27 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:27 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:38:27 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:28 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.362s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:28 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:28 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Deleted volume successfully. Jul 15 18:38:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c48bf77e-b37d-4fe0-8407-5415495cfa2f tempest-VolumesListAdminTestJSON-1686222196 None] Lock "cinder-2b0a2332-21dd-45a3-96cb-9eb1d403bb60-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:28 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.374s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:28 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:28 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Deleted volume successfully. Jul 15 18:38:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e6866c70-e883-4aec-9dac-be8bb4d31a06 tempest-VolumesListAdminTestJSON-692269236 None] Lock "cinder-8d8ea60e-f0d9-4ba2-b737-ed9266a9c088-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "cinder-18756497-0c82-44d5-9462-22580e4c0dda-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "cinder-18756497-0c82-44d5-9462-22580e4c0dda-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "cinder-quobyte-18756497-0c82-44d5-9462-22580e4c0dda" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "cinder-quobyte-18756497-0c82-44d5-9462-22580e4c0dda" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:28 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[319edf81-6224-4c57-bd5a-55cd7775cec7]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-18756497-0c82-44d5-9462-22580e4c0dda {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:28 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-18756497-0c82-44d5-9462-22580e4c0dda Jul 15 18:38:28 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:29 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-18756497-0c82-44d5-9462-22580e4c0dda" returned: 0 in 0.458s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-18756497-0c82-44d5-9462-22580e4c0dda {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:29 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-18756497-0c82-44d5-9462-22580e4c0dda Jul 15 18:38:29 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:29 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-18756497-0c82-44d5-9462-22580e4c0dda" returned: 0 in 0.272s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "cinder-quobyte-18756497-0c82-44d5-9462-22580e4c0dda" released by "delete_volume" :: held 0.815s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Created reservations ['df198fed-8575-4590-ab5d-98f05414428e', '98f52f79-4c14-4248-af53-fcbe3011516a', '21a782c4-751d-4400-ba59-05081ba457c6', '1bb05b8c-63be-4594-97c2-f207748d8d2d'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:29 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:38:29 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "cinder-f5e7b455-a1c4-44c0-9615-91dd3b0af119-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Lock "cinder-f5e7b455-a1c4-44c0-9615-91dd3b0af119-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "cinder-quobyte-f5e7b455-a1c4-44c0-9615-91dd3b0af119" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Lock "cinder-quobyte-f5e7b455-a1c4-44c0-9615-91dd3b0af119" acquired by "delete_volume" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:29 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.394s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:30 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Deleted volume successfully. Jul 15 18:38:30 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a92f08-ae9f-475b-a620-16c94bdd2782]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-deddeb36-c71e-4582-b8cf-a300e5e56b62 tempest-VolumesListAdminTestJSON-1686222196 None] Lock "cinder-18756497-0c82-44d5-9462-22580e4c0dda-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:30 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119 Jul 15 18:38:30 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:30 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119" returned: 0 in 0.835s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:30 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119 Jul 15 18:38:30 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:31 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f5e7b455-a1c4-44c0-9615-91dd3b0af119" returned: 0 in 0.606s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Lock "cinder-quobyte-f5e7b455-a1c4-44c0-9615-91dd3b0af119" released by "delete_volume" :: held 1.506s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:31 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Created reservations ['66f1a2ee-e6cb-49dc-929f-d32dc33a2214', '905f4016-599e-477a-868c-d3ce62cb826a', '0ccecd75-b2c1-4eb4-a693-2269a1d86781', 'e4e55829-9b8d-4aa0-a19a-db3b281b8653'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:31 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:38:31 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:38:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:32 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.925s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:32 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Deleted volume successfully. Jul 15 18:38:32 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:38:32 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:33 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-57585f03-7e77-4035-9ba8-6efe4abfdc9b tempest-VolumesListAdminTestJSON-1686222196 None] Lock "cinder-f5e7b455-a1c4-44c0-9615-91dd3b0af119-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:34 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 1.576s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:34 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:34 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:38:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:38:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Flow 'volume_create_manager' (17f3cd9a-12db-4e15-86cf-c8f471df8424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2a2a4e-0073-4b33-bcf2-80181f40eb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2a2a4e-0073-4b33-bcf2-80181f40eb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ff6280-f930-40fa-8b6b-2150d5a535b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b6ce9e4feb4b6cb62d3d7dd1a87b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:35Z,use_quota=True,user_id='be0117034b6643a58aa2441f32845b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425562ed-050d-4082-948e-a460382e138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425562ed-050d-4082-948e-a460382e138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcaf04ce-b192-481c-87b6-b61e51a02c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcaf04ce-b192-481c-87b6-b61e51a02c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ff6280-f930-40fa-8b6b-2150d5a535b4', 'volume_name': 'volume-59ff6280-f930-40fa-8b6b-2150d5a535b4', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38488e7a-ee7d-494a-8bd4-05878e6a1c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38488e7a-ee7d-494a-8bd4-05878e6a1c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2efc66-5b14-493b-9f0b-cd7a7ccaa43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:35 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Volume 59ff6280-f930-40fa-8b6b-2150d5a535b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ff6280-f930-40fa-8b6b-2150d5a535b4', 'volume_size': 1} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ff6280-f930-40fa-8b6b-2150d5a535b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b6ce9e4feb4b6cb62d3d7dd1a87b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:35Z,use_quota=True,user_id='be0117034b6643a58aa2441f32845b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Creating volume 59ff6280-f930-40fa-8b6b-2150d5a535b4 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:35 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:38:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-59ff6280-f930-40fa-8b6b-2150d5a535b4 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:35 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-59ff6280-f930-40fa-8b6b-2150d5a535b4 1073741824 Jul 15 18:38:35 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:36 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-59ff6280-f930-40fa-8b6b-2150d5a535b4 1073741824" returned: 0 in 1.184s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-59ff6280-f930-40fa-8b6b-2150d5a535b4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:36 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-59ff6280-f930-40fa-8b6b-2150d5a535b4 Jul 15 18:38:36 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:37 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-59ff6280-f930-40fa-8b6b-2150d5a535b4" returned: 0 in 0.454s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2efc66-5b14-493b-9f0b-cd7a7ccaa43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ff6280-f930-40fa-8b6b-2150d5a535b4', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ba1266-5078-4d2d-9774-ed00395dedcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:37 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Volume volume-59ff6280-f930-40fa-8b6b-2150d5a535b4 (59ff6280-f930-40fa-8b6b-2150d5a535b4): created successfully Jul 15 18:38:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ba1266-5078-4d2d-9774-ed00395dedcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Flow 'volume_create_manager' (17f3cd9a-12db-4e15-86cf-c8f471df8424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-29df360c-d1f3-4905-9fe3-8f05616c1e85 tempest-CinderUnicodeTest-665441679 None] Created volume successfully. Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Flow 'volume_create_manager' (189b4e7d-1828-41e3-9adf-fc59fffd917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc9d6e5-a4e4-4f9c-bc9b-2d7ff52e386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc9d6e5-a4e4-4f9c-bc9b-2d7ff52e386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-166040355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a115367-7cf2-47cc-b8d6-3e596caf8e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b6ce9e4feb4b6cb62d3d7dd1a87b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:39Z,use_quota=True,user_id='be0117034b6643a58aa2441f32845b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9efa1631-6c3b-429c-8aef-e503bf7c791e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9efa1631-6c3b-429c-8aef-e503bf7c791e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3408c24d-3e97-494f-a223-826125b0b441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3408c24d-3e97-494f-a223-826125b0b441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a115367-7cf2-47cc-b8d6-3e596caf8e95', 'volume_name': 'volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3e0093-57f5-4a8f-a063-e4764a239fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3e0093-57f5-4a8f-a063-e4764a239fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26b56e9-e7c1-46df-8816-c83ae512bb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:38 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Volume 6a115367-7cf2-47cc-b8d6-3e596caf8e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95', 'volume_size': 1} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-166040355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a115367-7cf2-47cc-b8d6-3e596caf8e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b6ce9e4feb4b6cb62d3d7dd1a87b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:39Z,use_quota=True,user_id='be0117034b6643a58aa2441f32845b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Creating volume 6a115367-7cf2-47cc-b8d6-3e596caf8e95 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:38 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:38:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:39 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 1073741824 Jul 15 18:38:39 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:39 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Flow 'volume_create_manager' (3ca9eabe-053e-4aaa-b4b0-1930e73a6376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb1a8b3-0293-4fb6-965f-e02c22618e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb1a8b3-0293-4fb6-965f-e02c22618e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-412171648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111b131c-05ca-4ea8-b0f8-d36ff8395e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deb81370a894e7d8ecd0e50b92a2e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:40Z,use_quota=True,user_id='128691aae40e4be295e36e55385b953f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f5b672-5f28-4330-b42a-42a58e836f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f5b672-5f28-4330-b42a-42a58e836f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2610b5-23c2-406b-83e0-16b9ed7703ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2610b5-23c2-406b-83e0-16b9ed7703ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111b131c-05ca-4ea8-b0f8-d36ff8395e34', 'volume_name': 'volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:40 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b51271-0ca0-4261-ba5b-de3aa24e99bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b51271-0ca0-4261-ba5b-de3aa24e99bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e05379-8d23-414e-bba4-d355279a63e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:40 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Volume 111b131c-05ca-4ea8-b0f8-d36ff8395e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34', 'volume_size': 1} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 1073741824" returned: 0 in 1.347s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:40 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 Jul 15 18:38:40 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:40 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95" returned: 0 in 0.532s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.658s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-412171648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111b131c-05ca-4ea8-b0f8-d36ff8395e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deb81370a894e7d8ecd0e50b92a2e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:40Z,use_quota=True,user_id='128691aae40e4be295e36e55385b953f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Creating volume 111b131c-05ca-4ea8-b0f8-d36ff8395e34 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:40 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:38:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:41 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34 1073741824 Jul 15 18:38:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26b56e9-e7c1-46df-8816-c83ae512bb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:41 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01e5ccf-b153-4bca-a49b-4c47100229af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:41 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Volume volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 (6a115367-7cf2-47cc-b8d6-3e596caf8e95): created successfully Jul 15 18:38:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01e5ccf-b153-4bca-a49b-4c47100229af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Flow 'volume_create_manager' (189b4e7d-1828-41e3-9adf-fc59fffd917b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:41 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-245a5eaa-1f4b-4d03-a9bd-b9c41d674a3f tempest-CinderUnicodeTest-665441679 None] Created volume successfully. Jul 15 18:38:41 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34 1073741824" returned: 0 in 0.949s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:42 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34 Jul 15 18:38:42 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:42 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34" returned: 0 in 0.536s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.062s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e05379-8d23-414e-bba4-d355279a63e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b814bd-5d40-4ca1-82b8-7f3f32cc762d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] Creating offline snapshot ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 of volume 6a115367-7cf2-47cc-b8d6-3e596caf8e95 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:38:42 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Volume volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34 (111b131c-05ca-4ea8-b0f8-d36ff8395e34): created successfully Jul 15 18:38:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b814bd-5d40-4ca1-82b8-7f3f32cc762d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Flow 'volume_create_manager' (3ca9eabe-053e-4aaa-b4b0-1930e73a6376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:42 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a43c04-fc4d-40ad-a2e7-745ec75a7d73]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:42 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-428665c8-8dfd-45cf-b2f0-b202f099da19 tempest-TestMinimumBasicScenario-1632801821 None] Created volume successfully. Jul 15 18:38:42 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 Jul 15 18:38:42 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:43 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95" returned: 0 in 0.760s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:43 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 1G Jul 15 18:38:43 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:44 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 1G" returned: 0 in 0.759s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:44 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 Jul 15 18:38:44 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:44 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5" returned: 0 in 0.580s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:44 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 is being set with open permissions: ugo+rw Jul 15 18:38:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:44 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 Jul 15 18:38:44 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:45 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5" returned: 0 in 0.399s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-9ef83030-01f2-4044-861d-39908c861836 req-70af6a38-cce0-4b15-aa09-fe3e7c59ab03 tempest-TestMinimumBasicScenario-1632801821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:45 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.info Jul 15 18:38:45 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:45 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.info" returned: 0 in 0.318s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:45 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.info is being set with open permissions: ugo+rw Jul 15 18:38:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:45 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.info Jul 15 18:38:45 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:45 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.info" returned: 0 in 0.367s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.362s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-9ef83030-01f2-4044-861d-39908c861836 req-70af6a38-cce0-4b15-aa09-fe3e7c59ab03 tempest-TestMinimumBasicScenario-1632801821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.716s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:45 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea377854-ba72-45f0-8896-733537141571]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-9ef83030-01f2-4044-861d-39908c861836 req-70af6a38-cce0-4b15-aa09-fe3e7c59ab03 tempest-TestMinimumBasicScenario-1632801821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:45 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-5e8c5a74-2b20-4d31-9c14-7d0d5817e176 tempest-CinderUnicodeTest-665441679 None] Create snapshot completed successfully Jul 15 18:38:46 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34 Jul 15 18:38:46 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:46 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-9ef83030-01f2-4044-861d-39908c861836 req-70af6a38-cce0-4b15-aa09-fe3e7c59ab03 tempest-TestMinimumBasicScenario-1632801821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34" returned: 0 in 0.468s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-9ef83030-01f2-4044-861d-39908c861836 req-70af6a38-cce0-4b15-aa09-fe3e7c59ab03 tempest-TestMinimumBasicScenario-1632801821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.508s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-9ef83030-01f2-4044-861d-39908c861836 req-70af6a38-cce0-4b15-aa09-fe3e7c59ab03 tempest-TestMinimumBasicScenario-1632801821 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9546bfe-af37-444b-9836-c220bea2fe95', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:38:46 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-9ef83030-01f2-4044-861d-39908c861836 req-70af6a38-cce0-4b15-aa09-fe3e7c59ab03 tempest-TestMinimumBasicScenario-1632801821 None] attachment_update completed successfully. Jul 15 18:38:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Acquiring lock "cinder-ec77d9d2-4025-433d-880a-6f0f7fd8a5a5-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Lock "cinder-ec77d9d2-4025-433d-880a-6f0f7fd8a5a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Acquiring lock "cinder-quobyte-6a115367-7cf2-47cc-b8d6-3e596caf8e95" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Lock "cinder-quobyte-6a115367-7cf2-47cc-b8d6-3e596caf8e95" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Acquiring lock "cinder-quobyte-ec77d9d2-4025-433d-880a-6f0f7fd8a5a5" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Lock "cinder-quobyte-ec77d9d2-4025-433d-880a-6f0f7fd8a5a5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Deleting offline snapshot ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 of volume 6a115367-7cf2-47cc-b8d6-3e596caf8e95 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:38:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] snapshot_file for this snap is: volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:38:47 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d74348-c54e-4f10-b5b5-7663293c296c]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:47 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 Jul 15 18:38:47 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:47 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5" returned: 0 in 0.675s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:38:47 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a09c24c-4ef9-40b6-b76c-586f9aa08050]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:47 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 Jul 15 18:38:47 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:48 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95" returned: 0 in 0.676s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:48 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 Jul 15 18:38:48 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:48 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5" returned: 0 in 0.445s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:48 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5 Jul 15 18:38:48 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:49 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95.ec77d9d2-4025-433d-880a-6f0f7fd8a5a5" returned: 0 in 0.459s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Lock "cinder-quobyte-ec77d9d2-4025-433d-880a-6f0f7fd8a5a5" released by "_delete_snapshot" :: held 2.395s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Lock "cinder-quobyte-6a115367-7cf2-47cc-b8d6-3e596caf8e95" released by "delete_snapshot" :: held 2.432s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:49 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Created reservations ['e111dd8a-4b31-4337-bd45-12158bb15d9e', '6bbc3bc3-5806-4e93-a8aa-c5b2c547b22a', '166dd5ad-9c59-4a72-980d-adf31e24e914', '4d28ae14-9f41-4a96-b055-a372d8854754'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:49 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Delete snapshot completed successfully. Jul 15 18:38:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c74f7093-d2c9-4159-9ed3-b702c8da148d tempest-CinderUnicodeTest-665441679 None] Lock "cinder-ec77d9d2-4025-433d-880a-6f0f7fd8a5a5-delete_snapshot" released by "delete_snapshot" :: held 2.654s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Flow 'volume_create_manager' (30fdc6ce-739f-43b3-af2c-309a1a3b8203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea768178-787c-46af-950e-95a96011b158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea768178-787c-46af-950e-95a96011b158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1134437108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f4d5b7-8092-4d83-9546-df9b3f86fca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc467b8b52bb45f7ac529a077f758a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:50Z,use_quota=True,user_id='38c00ebc59bb483d88900e58ef050d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389c785e-bddd-42bd-b3d7-e5ee0417cadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389c785e-bddd-42bd-b3d7-e5ee0417cadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f67bb89-9670-454b-916a-1cee9e02cd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f67bb89-9670-454b-916a-1cee9e02cd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f4d5b7-8092-4d83-9546-df9b3f86fca8', 'volume_name': 'volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222fb08f-347d-46dc-b7c6-87d20c6c3ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222fb08f-347d-46dc-b7c6-87d20c6c3ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6b216c-20a3-48a8-9e99-0888b3739b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:50 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Volume a6f4d5b7-8092-4d83-9546-df9b3f86fca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8', 'volume_size': 1} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1134437108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f4d5b7-8092-4d83-9546-df9b3f86fca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc467b8b52bb45f7ac529a077f758a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:50Z,use_quota=True,user_id='38c00ebc59bb483d88900e58ef050d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Creating volume a6f4d5b7-8092-4d83-9546-df9b3f86fca8 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:50 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:50 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8 1073741824 Jul 15 18:38:50 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Acquiring lock "cinder-6a115367-7cf2-47cc-b8d6-3e596caf8e95-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Lock "cinder-6a115367-7cf2-47cc-b8d6-3e596caf8e95-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Acquiring lock "cinder-quobyte-6a115367-7cf2-47cc-b8d6-3e596caf8e95" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Lock "cinder-quobyte-6a115367-7cf2-47cc-b8d6-3e596caf8e95" acquired by "delete_volume" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eab7010-ad99-4448-b452-25601f6d61f3]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:50 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 Jul 15 18:38:50 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:50 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8 1073741824" returned: 0 in 0.572s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:50 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95" returned: 0 in 0.446s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:50 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8 Jul 15 18:38:50 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:50 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95 Jul 15 18:38:50 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:51 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8" returned: 0 in 0.279s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6b216c-20a3-48a8-9e99-0888b3739b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:51 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47775aa4-6a7a-4e7d-81a6-5319e05185f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-6a115367-7cf2-47cc-b8d6-3e596caf8e95" returned: 0 in 0.282s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Lock "cinder-quobyte-6a115367-7cf2-47cc-b8d6-3e596caf8e95" released by "delete_volume" :: held 0.788s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:51 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Volume volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8 (a6f4d5b7-8092-4d83-9546-df9b3f86fca8): created successfully Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47775aa4-6a7a-4e7d-81a6-5319e05185f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Flow 'volume_create_manager' (30fdc6ce-739f-43b3-af2c-309a1a3b8203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:51 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b26fbd5d-34ff-4696-9180-dd35883ea9d8 tempest-VolumesTransfersV357Test-2052086084 None] Created volume successfully. Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Created reservations ['4e4468ae-ce55-45d0-a796-8055583ecb2e', 'c2889c9a-c10d-4837-8679-e3a3ea03b0ec', '35825188-43fe-45b3-a260-d7e133e5c8d2', '42183692-3171-41d7-a4c9-0b754d19df5b'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:51 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:38:51 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Acquiring lock "cinder-59ff6280-f930-40fa-8b6b-2150d5a535b4-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Lock "cinder-59ff6280-f930-40fa-8b6b-2150d5a535b4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Acquiring lock "cinder-quobyte-59ff6280-f930-40fa-8b6b-2150d5a535b4" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Lock "cinder-quobyte-59ff6280-f930-40fa-8b6b-2150d5a535b4" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a8268f-ffe1-4152-b541-051098bf59c7]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-59ff6280-f930-40fa-8b6b-2150d5a535b4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:51 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.304s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:51 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Deleted volume successfully. Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1283c4bd-3bbf-4e4d-8596-ca24bf7b444c tempest-CinderUnicodeTest-665441679 None] Lock "cinder-6a115367-7cf2-47cc-b8d6-3e596caf8e95-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:51 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-59ff6280-f930-40fa-8b6b-2150d5a535b4 Jul 15 18:38:51 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:51 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-59ff6280-f930-40fa-8b6b-2150d5a535b4" returned: 0 in 0.401s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-59ff6280-f930-40fa-8b6b-2150d5a535b4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:51 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-59ff6280-f930-40fa-8b6b-2150d5a535b4 Jul 15 18:38:51 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:52 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-59ff6280-f930-40fa-8b6b-2150d5a535b4" returned: 0 in 0.293s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Lock "cinder-quobyte-59ff6280-f930-40fa-8b6b-2150d5a535b4" released by "delete_volume" :: held 0.746s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:52 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Created reservations ['a2c32ac4-ebc7-4dae-9571-a796f13d6dd6', '70f0058a-958d-4785-a391-fdef1c0de6ca', '849da6a7-e251-4dd9-b66e-a01595aabb6f', 'fb06467d-b808-42c5-9368-8ad19d2f7ff2'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:52 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:38:52 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:52 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.394s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:52 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:52 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Deleted volume successfully. Jul 15 18:38:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-de9c60cf-af86-4266-9581-7c6cd6816aad tempest-CinderUnicodeTest-665441679 None] Lock "cinder-59ff6280-f930-40fa-8b6b-2150d5a535b4-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:53 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-88dafd50-634d-4627-a8c4-37a5a1cdd0f4 tempest-VolumesTransfersV357Test-1943397447 None] Transfer volume completed successfully. Jul 15 18:38:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Acquiring lock "cinder-a6f4d5b7-8092-4d83-9546-df9b3f86fca8-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Lock "cinder-a6f4d5b7-8092-4d83-9546-df9b3f86fca8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Acquiring lock "cinder-quobyte-a6f4d5b7-8092-4d83-9546-df9b3f86fca8" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Lock "cinder-quobyte-a6f4d5b7-8092-4d83-9546-df9b3f86fca8" acquired by "delete_volume" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:53 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e435c3-9473-4fa5-a7ad-f67aa86f53c1]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:54 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8 Jul 15 18:38:54 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:54 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8" returned: 0 in 0.448s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:54 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8 Jul 15 18:38:54 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:54 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a6f4d5b7-8092-4d83-9546-df9b3f86fca8" returned: 0 in 0.378s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Lock "cinder-quobyte-a6f4d5b7-8092-4d83-9546-df9b3f86fca8" released by "delete_volume" :: held 0.886s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:54 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Created reservations ['30092b95-6071-4af0-8471-1926cec44b59', 'cc796ffe-4291-41cf-923a-d0aacccba3a0', '78f26e0f-d3fc-4994-b2d9-ff8041f42000', 'b780e211-5e89-4757-8d93-c329cf0b9421'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:55 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:38:55 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:55 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.430s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:55 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:55 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Deleted volume successfully. Jul 15 18:38:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a674fb5e-e4c7-4fc3-8fdc-eb598a5986e9 tempest-VolumesTransfersV357Test-2038604002 None] Lock "cinder-a6f4d5b7-8092-4d83-9546-df9b3f86fca8-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Flow 'volume_create_manager' (1aa16d7e-3cfd-41fe-9bec-059bfd170102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c0c6f1-568a-405e-a012-836353a61c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c0c6f1-568a-405e-a012-836353a61c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-424117015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35799c58-fa01-4529-93aa-06146d2f2919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc467b8b52bb45f7ac529a077f758a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:56Z,use_quota=True,user_id='38c00ebc59bb483d88900e58ef050d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fae4911-f583-41d2-8089-8431e3112181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fae4911-f583-41d2-8089-8431e3112181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0f76af-0a8e-4af6-955d-387213b65b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0f76af-0a8e-4af6-955d-387213b65b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35799c58-fa01-4529-93aa-06146d2f2919', 'volume_name': 'volume-35799c58-fa01-4529-93aa-06146d2f2919', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da67a4f-5b98-4170-b6c0-e3bd6a2e4dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da67a4f-5b98-4170-b6c0-e3bd6a2e4dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed89128-1db3-46ea-b712-193c13152e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:56 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Volume 35799c58-fa01-4529-93aa-06146d2f2919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35799c58-fa01-4529-93aa-06146d2f2919', 'volume_size': 1} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-424117015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35799c58-fa01-4529-93aa-06146d2f2919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc467b8b52bb45f7ac529a077f758a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:38:56Z,use_quota=True,user_id='38c00ebc59bb483d88900e58ef050d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Creating volume 35799c58-fa01-4529-93aa-06146d2f2919 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:38:56 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-35799c58-fa01-4529-93aa-06146d2f2919 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:56 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-35799c58-fa01-4529-93aa-06146d2f2919 1073741824 Jul 15 18:38:56 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:56 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-35799c58-fa01-4529-93aa-06146d2f2919 1073741824" returned: 0 in 0.485s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-35799c58-fa01-4529-93aa-06146d2f2919 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:56 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-35799c58-fa01-4529-93aa-06146d2f2919 Jul 15 18:38:56 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:57 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-35799c58-fa01-4529-93aa-06146d2f2919" returned: 0 in 0.402s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:38:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed89128-1db3-46ea-b712-193c13152e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35799c58-fa01-4529-93aa-06146d2f2919', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92210c4-0005-4ac7-b324-6532eb441c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:38:57 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Volume volume-35799c58-fa01-4529-93aa-06146d2f2919 (35799c58-fa01-4529-93aa-06146d2f2919): created successfully Jul 15 18:38:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92210c4-0005-4ac7-b324-6532eb441c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:38:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Flow 'volume_create_manager' (1aa16d7e-3cfd-41fe-9bec-059bfd170102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:38:57 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-dd4660d0-227b-4263-ab14-b5b6ec6deaff tempest-VolumesTransfersV357Test-2052086084 None] Created volume successfully. Jul 15 18:38:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Acquiring lock "cinder-35799c58-fa01-4529-93aa-06146d2f2919-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Lock "cinder-35799c58-fa01-4529-93aa-06146d2f2919-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Acquiring lock "cinder-quobyte-35799c58-fa01-4529-93aa-06146d2f2919" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:38:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Lock "cinder-quobyte-35799c58-fa01-4529-93aa-06146d2f2919" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:38:58 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9bb89b-ee63-4a2f-acdf-73e5a9403802]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:38:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-35799c58-fa01-4529-93aa-06146d2f2919 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:58 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-35799c58-fa01-4529-93aa-06146d2f2919 Jul 15 18:38:58 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:59 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-35799c58-fa01-4529-93aa-06146d2f2919" returned: 0 in 0.404s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-35799c58-fa01-4529-93aa-06146d2f2919 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:59 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-35799c58-fa01-4529-93aa-06146d2f2919 Jul 15 18:38:59 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:59 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-35799c58-fa01-4529-93aa-06146d2f2919" returned: 0 in 0.298s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Lock "cinder-quobyte-35799c58-fa01-4529-93aa-06146d2f2919" released by "delete_volume" :: held 0.745s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Created reservations ['28756c93-432e-45d4-aa4c-79d103972df2', 'd87a2ef8-aee7-45e2-84a9-ccc16a74b7cf', '8ac2a843-cd47-43f8-bfda-e9ece4549f61', '2eb7c64a-3f92-4d38-87ae-2740860704a3'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:38:59 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:38:59 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:38:59 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.273s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:38:59 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Deleted volume successfully. Jul 15 18:38:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3e183c41-ae3c-41e7-b602-f4f03b4391f3 tempest-VolumesTransfersV357Test-2038604002 None] Lock "cinder-35799c58-fa01-4529-93aa-06146d2f2919-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Flow 'volume_create_manager' (80851c0f-a295-40cb-b312-029a8b59bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47f9ff7-1100-4ef1-a9f1-f99e561edfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47f9ff7-1100-4ef1-a9f1-f99e561edfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1793765564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a67324-25fe-4785-bb41-c53f6e069cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eac6ba66bb1426bad1d372d5931e949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:01Z,use_quota=True,user_id='7433aea7986041789578d9f29e2a97ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d413d3-c901-4a23-9f30-74168149ecb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d413d3-c901-4a23-9f30-74168149ecb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ea7e10-cd07-4e54-9886-a30977146254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ea7e10-cd07-4e54-9886-a30977146254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a67324-25fe-4785-bb41-c53f6e069cf4', 'volume_name': 'volume-c1a67324-25fe-4785-bb41-c53f6e069cf4', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1aabe37-6544-42f5-b088-fbc0a4285fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1aabe37-6544-42f5-b088-fbc0a4285fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b55be2-5ca2-46e3-8061-ac0fc7bd6aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:00 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Volume c1a67324-25fe-4785-bb41-c53f6e069cf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a67324-25fe-4785-bb41-c53f6e069cf4', 'volume_size': 1} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1793765564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a67324-25fe-4785-bb41-c53f6e069cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eac6ba66bb1426bad1d372d5931e949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:01Z,use_quota=True,user_id='7433aea7986041789578d9f29e2a97ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Creating volume c1a67324-25fe-4785-bb41-c53f6e069cf4 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:00 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:39:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:00 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4 1073741824 Jul 15 18:39:00 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:01 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4 1073741824" returned: 0 in 0.578s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:01 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4 Jul 15 18:39:01 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:01 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4" returned: 0 in 0.282s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:39:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b55be2-5ca2-46e3-8061-ac0fc7bd6aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a67324-25fe-4785-bb41-c53f6e069cf4', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cc8e47-f636-488f-9175-263bab781b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:01 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Volume volume-c1a67324-25fe-4785-bb41-c53f6e069cf4 (c1a67324-25fe-4785-bb41-c53f6e069cf4): created successfully Jul 15 18:39:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cc8e47-f636-488f-9175-263bab781b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Flow 'volume_create_manager' (80851c0f-a295-40cb-b312-029a8b59bee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:01 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-5f069c28-0e22-403e-a2e2-19b086c47481 tempest-AttachVolumeNegativeTest-1381542441 None] Created volume successfully. Jul 15 18:39:03 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=85,cinder:UPDATE=103,cinder:INSERT=23,cinder:DELETE=9 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:39:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-a295799e-c98e-44cc-9abe-f563fd42a652 req-d7613dee-2843-4150-a603-00d9f9a13cef tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-a295799e-c98e-44cc-9abe-f563fd42a652 req-d7613dee-2843-4150-a603-00d9f9a13cef tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:03 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2753300e-d14b-4ff5-8a5e-51f0f874e133]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-a295799e-c98e-44cc-9abe-f563fd42a652 req-d7613dee-2843-4150-a603-00d9f9a13cef tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:03 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4 Jul 15 18:39:03 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:03 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-a295799e-c98e-44cc-9abe-f563fd42a652 req-d7613dee-2843-4150-a603-00d9f9a13cef tempest-AttachVolumeNegativeTest-1381542441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4" returned: 0 in 0.431s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-a295799e-c98e-44cc-9abe-f563fd42a652 req-d7613dee-2843-4150-a603-00d9f9a13cef tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.456s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-a295799e-c98e-44cc-9abe-f563fd42a652 req-d7613dee-2843-4150-a603-00d9f9a13cef tempest-AttachVolumeNegativeTest-1381542441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-c1a67324-25fe-4785-bb41-c53f6e069cf4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd37b7a11-b149-40d5-b9a5-9d55434e46b1', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:39:04 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-a295799e-c98e-44cc-9abe-f563fd42a652 req-d7613dee-2843-4150-a603-00d9f9a13cef tempest-AttachVolumeNegativeTest-1381542441 None] attachment_update completed successfully. Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Flow 'volume_create_manager' (2d728211-f2c3-4449-b520-fba1e7e4e912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e167548a-6ba7-4348-b1b4-a091c76069c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e167548a-6ba7-4348-b1b4-a091c76069c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-620935323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdc856049ff452b87bc56c2191c7de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:06Z,use_quota=True,user_id='dc57006f4eef40478403c911386a61a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f358f0-9705-47eb-aedd-ca8bbc9fb105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f358f0-9705-47eb-aedd-ca8bbc9fb105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05e54dd-d3ff-4d5f-b385-0d0bae62838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.image.glance [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Creating Keystone auth plugin from conf {{(pid=87217) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:39:06 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-0aacc982-771e-480f-b60a-3e920e8ffc75 req-fe346481-3ae5-4d33-a87d-3dedca22c3b9 tempest-AttachVolumeNegativeTest-1381542441 None] Terminate volume connection completed successfully. Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0aacc982-771e-480f-b60a-3e920e8ffc75 req-fe346481-3ae5-4d33-a87d-3dedca22c3b9 tempest-AttachVolumeNegativeTest-1381542441 None] Deleting attachment d37b7a11-b149-40d5-b9a5-9d55434e46b1. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05e54dd-d3ff-4d5f-b385-0d0bae62838a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724', 'volume_name': 'volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724', 'volume_size': 1, 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1cc7d7f865b4961944a3804db21f9fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'created_at': datetime.datetime(2026, 7, 15, 16, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58cd658a-6d16-40ff-85de-7b9a03ec1256/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccc6eab-33a0-441e-b9d7-1b88ff13ca90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccc6eab-33a0-441e-b9d7-1b88ff13ca90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc99b5a-a0ea-4394-ae04-57260db4e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:06 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Volume aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724', 'volume_size': 1, 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1cc7d7f865b4961944a3804db21f9fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'created_at': datetime.datetime(2026, 7, 15, 16, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58cd658a-6d16-40ff-85de-7b9a03ec1256/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 15 18:39:06 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Trying to clone aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 from image 58cd658a-6d16-40ff-85de-7b9a03ec1256 at location (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]). {{(pid=87217) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:39:07 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:39:07 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Image download 20.69 MB at 20.69 MB/s Jul 15 18:39:07 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe11dfb-98e9-4aaa-9a1e-913333c51060]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:07 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD Jul 15 18:39:07 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:07 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:07 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Temporary image 58cd658a-6d16-40ff-85de-7b9a03ec1256 is fetched for user dc57006f4eef40478403c911386a61a5. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:39:07 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7838de0-ad75-4b50-a8be-48db706a8c09]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:07 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD Jul 15 18:39:07 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:08 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD" returned: 0 in 0.647s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-620935323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdc856049ff452b87bc56c2191c7de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:06Z,use_quota=True,user_id='dc57006f4eef40478403c911386a61a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:39:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Creating volume aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:39:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:08 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:39:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:08 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 1073741824 Jul 15 18:39:08 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:09 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 1073741824" returned: 0 in 0.614s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:09 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 Jul 15 18:39:09 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:09 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724" returned: 0 in 0.359s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:39:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:09 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Attempting download of 58cd658a-6d16-40ff-85de-7b9a03ec1256 ((None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}])) to volume aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:39:09 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f4aa32-8a7d-4e18-88a9-4a898f57e030]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_5zu5r8uz {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:09 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_5zu5r8uz Jul 15 18:39:09 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:10 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_5zu5r8uz" returned: 0 in 0.412s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_5zu5r8uz {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:10 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_5zu5r8uz Jul 15 18:39:10 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:10 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_5zu5r8uz" returned: 1 in 0.421s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_5zu5r8uz' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:39:10 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbfbc18-81fa-400a-b2d8-802124a30e0d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:10 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD Jul 15 18:39:10 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:10 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:10 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] 58cd658a-6d16-40ff-85de-7b9a03ec1256 was qcow2, converting to raw {{(pid=87217) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:39:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:10 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 Jul 15 18:39:10 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:12 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724" returned: 0 in 1.640s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:12 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_fdniunezdevstack@QuobyteHD, size 112.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:39:12 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Converted 112.00 MB image at 68.26 MB/s Jul 15 18:39:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:12 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 1G Jul 15 18:39:12 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:12 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 1G" returned: 0 in 0.331s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:12 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ef306a-8a41-4b7f-855d-85f1c2fb89c9]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:13 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 Jul 15 18:39:13 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:13 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724" returned: 0 in 0.447s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:13 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 Jul 15 18:39:13 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:13 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724" returned: 1 in 0.422s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Downloaded image 58cd658a-6d16-40ff-85de-7b9a03ec1256 ((None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}])) to volume aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 successfully. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Temporary image 58cd658a-6d16-40ff-85de-7b9a03ec1256 for user dc57006f4eef40478403c911386a61a5 is deleted. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Marking volume aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 as bootable. {{(pid=87217) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Copying metadata from image 58cd658a-6d16-40ff-85de-7b9a03ec1256 to aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724. {{(pid=87217) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Creating volume glance metadata for volume aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 backed by image 58cd658a-6d16-40ff-85de-7b9a03ec1256 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87217) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=90,cinder:UPDATE=123,cinder:DELETE=11,cinder:INSERT=29 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc99b5a-a0ea-4394-ae04-57260db4e889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724', 'volume_size': 1, 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1cc7d7f865b4961944a3804db21f9fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'created_at': datetime.datetime(2026, 7, 15, 16, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58cd658a-6d16-40ff-85de-7b9a03ec1256/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b699d633-b8a0-48cc-abee-98eaed35ca03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:13 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Volume volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 (aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724): created successfully Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b699d633-b8a0-48cc-abee-98eaed35ca03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Flow 'volume_create_manager' (2d728211-f2c3-4449-b520-fba1e7e4e912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:14 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-fc2f80b8-383d-4e27-9892-0eae9669e545 tempest-VolumesExtendTest-979517715 None] Created volume successfully. Jul 15 18:39:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6fde63f6-375f-489c-a2f4-b6e11b963027 tempest-VolumesExtendTest-979517715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6fde63f6-375f-489c-a2f4-b6e11b963027 tempest-VolumesExtendTest-979517715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:15 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[241df732-e5ac-4e1d-afcb-c1330f7c1755]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6fde63f6-375f-489c-a2f4-b6e11b963027 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:15 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 Jul 15 18:39:15 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:15 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6fde63f6-375f-489c-a2f4-b6e11b963027 tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724" returned: 0 in 0.429s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6fde63f6-375f-489c-a2f4-b6e11b963027 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:15 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 Jul 15 18:39:15 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:16 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6fde63f6-375f-489c-a2f4-b6e11b963027 tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724" returned: 1 in 0.445s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6fde63f6-375f-489c-a2f4-b6e11b963027 tempest-VolumesExtendTest-979517715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:39:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6fde63f6-375f-489c-a2f4-b6e11b963027 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 2G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6fde63f6-375f-489c-a2f4-b6e11b963027 tempest-VolumesExtendTest-979517715 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 2G" returned: 0 in 0.060s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6fde63f6-375f-489c-a2f4-b6e11b963027 tempest-VolumesExtendTest-979517715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.999s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:16 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6fde63f6-375f-489c-a2f4-b6e11b963027 tempest-VolumesExtendTest-979517715 None] Extend volume completed successfully. Jul 15 18:39:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Acquiring lock "cinder-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Lock "cinder-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Acquiring lock "cinder-quobyte-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Lock "cinder-quobyte-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724" acquired by "delete_volume" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:16 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57faaa8-702b-402c-84e5-396c9b417b9a]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:16 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 Jul 15 18:39:16 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:17 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724" returned: 0 in 0.428s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:17 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 Jul 15 18:39:17 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:17 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724" returned: 1 in 0.576s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:39:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:17 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724 Jul 15 18:39:17 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:18 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724" returned: 0 in 0.321s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Lock "cinder-quobyte-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724" released by "delete_volume" :: held 1.420s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:18 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Created reservations ['bb981e2c-7383-45fe-936b-0deb5b8b69a8', 'f9af9204-b5da-4352-95b9-10e3c6e5541c', '2fa00acf-506a-4f68-a054-297f58cbef0e', 'f84042a2-0904-47eb-9d4b-3752b43132f3'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:18 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:39:18 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:18 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.481s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:18 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:18 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Deleted volume successfully. Jul 15 18:39:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4f3ab8d3-77ca-4b2b-a62c-f89caa34496f tempest-VolumesExtendTest-979517715 None] Lock "cinder-aa0b2ee3-3a19-408b-9a6b-1ba41e8a9724-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Flow 'volume_create_manager' (de5d387f-cd86-4218-a2ec-c7a305793465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934eac98-27c9-4ab5-a8f8-c862087483bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934eac98-27c9-4ab5-a8f8-c862087483bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-571661200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998d4e83-729e-4e43-af9d-81bf33020c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdc856049ff452b87bc56c2191c7de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:19Z,use_quota=True,user_id='dc57006f4eef40478403c911386a61a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c92873-67b3-4511-8116-5042e3c22f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c92873-67b3-4511-8116-5042e3c22f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdce753-7877-42fc-aaca-47fd495f4211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdce753-7877-42fc-aaca-47fd495f4211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '998d4e83-729e-4e43-af9d-81bf33020c1b', 'volume_name': 'volume-998d4e83-729e-4e43-af9d-81bf33020c1b', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b277b8a1-3d71-4c86-a8f8-4ec8d9237706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b277b8a1-3d71-4c86-a8f8-4ec8d9237706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0013000-0511-4abf-8a2d-0e6512973104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:19 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Volume 998d4e83-729e-4e43-af9d-81bf33020c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-998d4e83-729e-4e43-af9d-81bf33020c1b', 'volume_size': 1} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-571661200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998d4e83-729e-4e43-af9d-81bf33020c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdc856049ff452b87bc56c2191c7de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:19Z,use_quota=True,user_id='dc57006f4eef40478403c911386a61a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Creating volume 998d4e83-729e-4e43-af9d-81bf33020c1b {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:19 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:39:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:19 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b 1073741824 Jul 15 18:39:19 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:20 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b 1073741824" returned: 0 in 0.482s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:20 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b Jul 15 18:39:20 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:20 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b" returned: 0 in 0.266s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:39:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0013000-0511-4abf-8a2d-0e6512973104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-998d4e83-729e-4e43-af9d-81bf33020c1b', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d724dcd9-4143-40c4-8c3c-d71fb43233e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:20 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Volume volume-998d4e83-729e-4e43-af9d-81bf33020c1b (998d4e83-729e-4e43-af9d-81bf33020c1b): created successfully Jul 15 18:39:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d724dcd9-4143-40c4-8c3c-d71fb43233e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Flow 'volume_create_manager' (de5d387f-cd86-4218-a2ec-c7a305793465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:20 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7e124e3d-1e5c-4bcc-a49a-e97de43cc850 tempest-VolumesExtendTest-979517715 None] Created volume successfully. Jul 15 18:39:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] Creating offline snapshot 4c3fbb43-1afa-4233-8219-fb58630c10a6 of volume 998d4e83-729e-4e43-af9d-81bf33020c1b {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:39:21 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac840a0-acf2-49ea-926e-6fada06f018b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:22 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b Jul 15 18:39:22 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:22 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b" returned: 0 in 0.551s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:22 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 1G Jul 15 18:39:22 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:22 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 1G" returned: 0 in 0.386s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-998d4e83-729e-4e43-af9d-81bf33020c1b -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:22 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-998d4e83-729e-4e43-af9d-81bf33020c1b -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 Jul 15 18:39:22 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:23 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-998d4e83-729e-4e43-af9d-81bf33020c1b -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6" returned: 0 in 0.299s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:23 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 is being set with open permissions: ugo+rw Jul 15 18:39:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:23 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 Jul 15 18:39:23 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:23 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6" returned: 0 in 0.255s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:23 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.info Jul 15 18:39:23 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:23 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.info" returned: 0 in 0.317s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:23 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.info is being set with open permissions: ugo+rw Jul 15 18:39:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:23 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.info Jul 15 18:39:23 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:24 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.info" returned: 0 in 0.286s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.210s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:24 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c35ff4d8-b58d-4966-8027-411cd2018b5e tempest-VolumesExtendTest-979517715 None] Create snapshot completed successfully Jul 15 18:39:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-697a4e35-4c3e-4d46-8f58-0e275e21925c tempest-VolumesExtendTest-979517715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-697a4e35-4c3e-4d46-8f58-0e275e21925c tempest-VolumesExtendTest-979517715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3cf623-f328-4132-961b-8dd1fb9ff354]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-697a4e35-4c3e-4d46-8f58-0e275e21925c tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:25 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b Jul 15 18:39:25 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:25 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-697a4e35-4c3e-4d46-8f58-0e275e21925c tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b" returned: 0 in 0.387s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-697a4e35-4c3e-4d46-8f58-0e275e21925c tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 2G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-697a4e35-4c3e-4d46-8f58-0e275e21925c tempest-VolumesExtendTest-979517715 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 2G" returned: 0 in 0.121s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-697a4e35-4c3e-4d46-8f58-0e275e21925c tempest-VolumesExtendTest-979517715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.547s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:25 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-697a4e35-4c3e-4d46-8f58-0e275e21925c tempest-VolumesExtendTest-979517715 None] Extend volume completed successfully. Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Acquiring lock "cinder-4c3fbb43-1afa-4233-8219-fb58630c10a6-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Lock "cinder-4c3fbb43-1afa-4233-8219-fb58630c10a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Acquiring lock "cinder-quobyte-998d4e83-729e-4e43-af9d-81bf33020c1b" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Lock "cinder-quobyte-998d4e83-729e-4e43-af9d-81bf33020c1b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Acquiring lock "cinder-quobyte-4c3fbb43-1afa-4233-8219-fb58630c10a6" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Lock "cinder-quobyte-4c3fbb43-1afa-4233-8219-fb58630c10a6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Deleting offline snapshot 4c3fbb43-1afa-4233-8219-fb58630c10a6 of volume 998d4e83-729e-4e43-af9d-81bf33020c1b {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] snapshot_file for this snap is: volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b290d9-3071-4e1c-afea-0591bd8874a3]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:26 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 Jul 15 18:39:26 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:26 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6" returned: 0 in 0.389s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-998d4e83-729e-4e43-af9d-81bf33020c1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[1059568a-8ed5-4ce1-b8b8-8f58eb1f57e2]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:27 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b Jul 15 18:39:27 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:27 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b" returned: 0 in 0.396s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:27 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 Jul 15 18:39:27 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:27 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6" returned: 0 in 0.421s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:27 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6 Jul 15 18:39:27 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:28 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b.4c3fbb43-1afa-4233-8219-fb58630c10a6" returned: 0 in 0.287s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Lock "cinder-quobyte-4c3fbb43-1afa-4233-8219-fb58630c10a6" released by "_delete_snapshot" :: held 1.615s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Lock "cinder-quobyte-998d4e83-729e-4e43-af9d-81bf33020c1b" released by "delete_snapshot" :: held 1.647s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:28 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Created reservations ['8c845bb1-af90-487a-b94d-4ccc0abe852c', '1a1ac062-0c7c-4cfa-b7f2-6c7efeb47297', '19097351-2c69-4b7a-a94f-f9d6d5e5fc6e', '530ca09c-8ec3-4588-80ce-af913e148f51'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:28 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Delete snapshot completed successfully. Jul 15 18:39:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f0b633c-bc76-49c6-a371-fcf1ae9a0bd5 tempest-VolumesExtendTest-979517715 None] Lock "cinder-4c3fbb43-1afa-4233-8219-fb58630c10a6-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Acquiring lock "cinder-998d4e83-729e-4e43-af9d-81bf33020c1b-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Lock "cinder-998d4e83-729e-4e43-af9d-81bf33020c1b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Acquiring lock "cinder-quobyte-998d4e83-729e-4e43-af9d-81bf33020c1b" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Lock "cinder-quobyte-998d4e83-729e-4e43-af9d-81bf33020c1b" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:28 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c78307e-d4f7-4ccf-8266-36db5f2cba67]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:29 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b Jul 15 18:39:29 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:29 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b" returned: 0 in 0.389s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:29 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b Jul 15 18:39:29 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:29 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-998d4e83-729e-4e43-af9d-81bf33020c1b" returned: 0 in 0.371s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Lock "cinder-quobyte-998d4e83-729e-4e43-af9d-81bf33020c1b" released by "delete_volume" :: held 0.849s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:29 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Created reservations ['1b334e8a-b28d-4f11-b5ee-b20e9397e4b0', '446fede0-0e3d-4e18-9585-ebd38cda480a', 'b39cc86d-fe1a-4acb-a404-9bbbec9b1597', '066cd093-99e2-4464-a342-53ffcacd78fc'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:29 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:39:29 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-c0d7d7ec-8b3b-40c2-88b8-d3e096a60dbf req-e315da1a-bf86-468f-b788-5294b64ef75f tempest-TestMinimumBasicScenario-1632801821 None] Terminate volume connection completed successfully. Jul 15 18:39:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-c0d7d7ec-8b3b-40c2-88b8-d3e096a60dbf req-e315da1a-bf86-468f-b788-5294b64ef75f tempest-TestMinimumBasicScenario-1632801821 None] Deleting attachment b9546bfe-af37-444b-9836-c220bea2fe95. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:39:30 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.551s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:30 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Deleted volume successfully. Jul 15 18:39:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-03ca8536-c434-4a99-bccd-3e2bc7b84d0d tempest-VolumesExtendTest-979517715 None] Lock "cinder-998d4e83-729e-4e43-af9d-81bf33020c1b-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Acquiring lock "cinder-111b131c-05ca-4ea8-b0f8-d36ff8395e34-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Lock "cinder-111b131c-05ca-4ea8-b0f8-d36ff8395e34-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Acquiring lock "cinder-quobyte-111b131c-05ca-4ea8-b0f8-d36ff8395e34" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Lock "cinder-quobyte-111b131c-05ca-4ea8-b0f8-d36ff8395e34" acquired by "delete_volume" :: waited 0.029s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:31 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa06b943-470a-4bcd-afba-dafd12bd8f8e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:31 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34 Jul 15 18:39:31 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:31 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34" returned: 0 in 0.430s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:31 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34 Jul 15 18:39:31 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:32 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-111b131c-05ca-4ea8-b0f8-d36ff8395e34" returned: 0 in 0.273s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Lock "cinder-quobyte-111b131c-05ca-4ea8-b0f8-d36ff8395e34" released by "delete_volume" :: held 0.754s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Created reservations ['be031f33-20eb-4499-9621-eca10f38b6c0', '2a12c604-0b05-4cb0-abd8-2c360f4db475', '32de4047-db84-43b5-b4dd-ed35ecb06834', '6f653720-506c-442a-96d8-5cb165833fa5'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:32 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:39:32 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:32 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.297s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:32 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Deleted volume successfully. Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-15d38f5b-b03d-4404-9a45-44d1898489e1 tempest-TestMinimumBasicScenario-1632801821 None] Lock "cinder-111b131c-05ca-4ea8-b0f8-d36ff8395e34-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:32 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:39:32 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:33 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.351s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:39:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:39:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Flow 'volume_create_manager' (9164b0f4-1168-4af7-bb49-44a2c2333d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb4e19f-c054-4c50-92e9-b9a843adec6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb4e19f-c054-4c50-92e9-b9a843adec6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-848145344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605f8250-3139-4ede-8bfd-edf1aeb96b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a916338b41d41b48baa2e52fc09967b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:34Z,use_quota=True,user_id='38b2f9adacdc4d608a20586bc75d3d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8477ccf-717a-430c-a142-5716cf26cab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8477ccf-717a-430c-a142-5716cf26cab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b7d330-582b-4f11-8de8-0b77ad7d092e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b7d330-582b-4f11-8de8-0b77ad7d092e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605f8250-3139-4ede-8bfd-edf1aeb96b37', 'volume_name': 'volume-605f8250-3139-4ede-8bfd-edf1aeb96b37', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad737404-7f82-4113-a0e9-3fef7748a7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad737404-7f82-4113-a0e9-3fef7748a7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a587eeb5-2ddb-4103-90fb-94d94747626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:34 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Volume 605f8250-3139-4ede-8bfd-edf1aeb96b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605f8250-3139-4ede-8bfd-edf1aeb96b37', 'volume_size': 1} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-848145344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605f8250-3139-4ede-8bfd-edf1aeb96b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a916338b41d41b48baa2e52fc09967b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:34Z,use_quota=True,user_id='38b2f9adacdc4d608a20586bc75d3d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Creating volume 605f8250-3139-4ede-8bfd-edf1aeb96b37 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:34 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:39:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:34 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 1073741824 Jul 15 18:39:34 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:35 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 1073741824" returned: 0 in 0.550s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:35 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 Jul 15 18:39:35 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:35 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37" returned: 0 in 0.307s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:39:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a587eeb5-2ddb-4103-90fb-94d94747626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605f8250-3139-4ede-8bfd-edf1aeb96b37', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6883959a-6e98-474f-b51c-a3ba58580f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:35 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Volume volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 (605f8250-3139-4ede-8bfd-edf1aeb96b37): created successfully Jul 15 18:39:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6883959a-6e98-474f-b51c-a3ba58580f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Flow 'volume_create_manager' (9164b0f4-1168-4af7-bb49-44a2c2333d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:35 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9b424922-0603-4074-9409-5baf6e7e2a2f tempest-VolumesSnapshotListTestJSON-1864146118 None] Created volume successfully. Jul 15 18:39:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] Creating offline snapshot eb3d3cab-7879-4be5-8406-a76bb46bd21d of volume 605f8250-3139-4ede-8bfd-edf1aeb96b37 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:39:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd00a4f9-34bc-41ce-802e-670a20550b89]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:36 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 Jul 15 18:39:36 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:36 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37" returned: 0 in 0.381s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:37 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d 1G Jul 15 18:39:37 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:37 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d 1G" returned: 0 in 0.402s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:37 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d Jul 15 18:39:37 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:37 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d" returned: 0 in 0.342s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:37 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d is being set with open permissions: ugo+rw Jul 15 18:39:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:37 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d Jul 15 18:39:37 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:37 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d" returned: 0 in 0.250s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:38 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.info Jul 15 18:39:38 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:38 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.info" returned: 0 in 0.269s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:38 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.info is being set with open permissions: ugo+rw Jul 15 18:39:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:38 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.info Jul 15 18:39:38 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:38 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.info" returned: 0 in 0.265s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:38 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4dd0d291-7892-4ba9-a1e1-dd15549627e7 tempest-VolumesSnapshotListTestJSON-1864146118 None] Create snapshot completed successfully Jul 15 18:39:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] Creating offline snapshot c5c39a4d-f875-498a-b03b-1410f20393c0 of volume 605f8250-3139-4ede-8bfd-edf1aeb96b37 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:39:40 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7aceba-c930-43d7-8fa4-b3525351916b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:40 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d Jul 15 18:39:40 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:40 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d" returned: 0 in 0.474s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-605f8250-3139-4ede-8bfd-edf1aeb96b37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:39:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:40 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 1G Jul 15 18:39:40 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:41 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 1G" returned: 0 in 0.478s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:41 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 Jul 15 18:39:41 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:41 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0" returned: 0 in 0.314s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:41 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 is being set with open permissions: ugo+rw Jul 15 18:39:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:41 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 Jul 15 18:39:41 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:41 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0" returned: 0 in 0.267s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.704s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:41 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d882f1e4-3db8-4090-9ee5-99ea5237745d tempest-VolumesSnapshotListTestJSON-1864146118 None] Create snapshot completed successfully Jul 15 18:39:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] Creating offline snapshot 7ccf0f4a-d149-4925-8bff-2148e46b5065 of volume 605f8250-3139-4ede-8bfd-edf1aeb96b37 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:39:42 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ec7fbb-afc8-4f7d-9c87-1be98f4b3f03]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:42 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 Jul 15 18:39:42 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:42 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0" returned: 0 in 0.463s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-605f8250-3139-4ede-8bfd-edf1aeb96b37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:39:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:42 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 1G Jul 15 18:39:42 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:43 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 1G" returned: 0 in 0.653s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:43 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 Jul 15 18:39:43 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:43 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065" returned: 0 in 0.388s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:43 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 is being set with open permissions: ugo+rw Jul 15 18:39:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:43 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 Jul 15 18:39:43 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:44 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065" returned: 0 in 0.266s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.893s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:44 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-81fc39a2-b30e-4261-b1a3-fe1d74014ae0 tempest-VolumesSnapshotListTestJSON-1864146118 None] Create snapshot completed successfully Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Flow 'volume_create_manager' (14e401de-687d-4646-9238-94c4817961fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4aa367-b39c-4b7a-adce-3199b9548b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4aa367-b39c-4b7a-adce-3199b9548b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-726346636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7823e46-f547-4fb0-9bae-011a4095777d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eac6ba66bb1426bad1d372d5931e949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:45Z,use_quota=True,user_id='7433aea7986041789578d9f29e2a97ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a2b2a6-a77c-4df9-a262-5c6a608b39ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a2b2a6-a77c-4df9-a262-5c6a608b39ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20cc551-7366-44f5-a9cf-bcf373ddce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20cc551-7366-44f5-a9cf-bcf373ddce95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7823e46-f547-4fb0-9bae-011a4095777d', 'volume_name': 'volume-a7823e46-f547-4fb0-9bae-011a4095777d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3250da-41fd-4a9c-9c2f-62bde01e131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3250da-41fd-4a9c-9c2f-62bde01e131b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb156516-0934-4596-868c-be4898b4631d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:45 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Volume a7823e46-f547-4fb0-9bae-011a4095777d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7823e46-f547-4fb0-9bae-011a4095777d', 'volume_size': 1} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-726346636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7823e46-f547-4fb0-9bae-011a4095777d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eac6ba66bb1426bad1d372d5931e949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:45Z,use_quota=True,user_id='7433aea7986041789578d9f29e2a97ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Creating volume a7823e46-f547-4fb0-9bae-011a4095777d {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:45 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:45 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d 1073741824 Jul 15 18:39:45 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "cinder-7ccf0f4a-d149-4925-8bff-2148e46b5065-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-7ccf0f4a-d149-4925-8bff-2148e46b5065-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "cinder-quobyte-605f8250-3139-4ede-8bfd-edf1aeb96b37" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-605f8250-3139-4ede-8bfd-edf1aeb96b37" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "cinder-quobyte-7ccf0f4a-d149-4925-8bff-2148e46b5065" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-7ccf0f4a-d149-4925-8bff-2148e46b5065" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Deleting offline snapshot 7ccf0f4a-d149-4925-8bff-2148e46b5065 of volume 605f8250-3139-4ede-8bfd-edf1aeb96b37 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] snapshot_file for this snap is: volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e0818a-b0c4-4838-bce9-e201045d0fee]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:45 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 Jul 15 18:39:45 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:45 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d 1073741824" returned: 0 in 0.540s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:45 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d Jul 15 18:39:45 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:46 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065" returned: 0 in 0.425s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-605f8250-3139-4ede-8bfd-edf1aeb96b37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e20e2a1-227f-45cf-8687-a38e5e713e97]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:46 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d" returned: 0 in 0.291s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb156516-0934-4596-868c-be4898b4631d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7823e46-f547-4fb0-9bae-011a4095777d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe6a844-6bde-4980-a626-e1c326331e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:46 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Volume volume-a7823e46-f547-4fb0-9bae-011a4095777d (a7823e46-f547-4fb0-9bae-011a4095777d): created successfully Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe6a844-6bde-4980-a626-e1c326331e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Flow 'volume_create_manager' (14e401de-687d-4646-9238-94c4817961fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:46 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-14220fe6-13bb-4ef1-b253-a45edc339fb4 tempest-AttachVolumeNegativeTest-1381542441 None] Created volume successfully. Jul 15 18:39:46 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 Jul 15 18:39:46 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:46 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0" returned: 0 in 0.408s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-605f8250-3139-4ede-8bfd-edf1aeb96b37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:39:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:46 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 Jul 15 18:39:46 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:47 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065" returned: 0 in 0.428s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:47 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065 Jul 15 18:39:47 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:47 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.7ccf0f4a-d149-4925-8bff-2148e46b5065" returned: 0 in 0.270s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-7ccf0f4a-d149-4925-8bff-2148e46b5065" released by "_delete_snapshot" :: held 1.684s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-605f8250-3139-4ede-8bfd-edf1aeb96b37" released by "delete_snapshot" :: held 1.718s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Created reservations ['81851600-6fbc-42c1-96e3-735c2aeeef76', 'c72b06a4-0b6f-4a05-a1f1-f88c9f5cad8b', '0394d98a-7aaa-4134-969a-4da1aae0fbb9', '848c7f1f-1939-411c-9f6c-88419389c58e'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:47 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Delete snapshot completed successfully. Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f81374b2-c3a7-4bbe-85af-104418a11782 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-7ccf0f4a-d149-4925-8bff-2148e46b5065-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "cinder-c5c39a4d-f875-498a-b03b-1410f20393c0-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-c5c39a4d-f875-498a-b03b-1410f20393c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "cinder-quobyte-605f8250-3139-4ede-8bfd-edf1aeb96b37" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-605f8250-3139-4ede-8bfd-edf1aeb96b37" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "cinder-quobyte-c5c39a4d-f875-498a-b03b-1410f20393c0" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-c5c39a4d-f875-498a-b03b-1410f20393c0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Deleting offline snapshot c5c39a4d-f875-498a-b03b-1410f20393c0 of volume 605f8250-3139-4ede-8bfd-edf1aeb96b37 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] snapshot_file for this snap is: volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a693e405-2ec9-4e57-b463-b2981bf2cde0]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:48 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 Jul 15 18:39:48 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:48 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0" returned: 0 in 0.471s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-605f8250-3139-4ede-8bfd-edf1aeb96b37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62a22ba-144e-49a0-9d3d-380e815f1bb4]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-b1426ca0-1691-4565-8830-8f6b39fe2688 req-8488f881-41cc-4136-a3b1-efd02c1cd499 tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-b1426ca0-1691-4565-8830-8f6b39fe2688 req-8488f881-41cc-4136-a3b1-efd02c1cd499 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3eac43-ca0a-45e6-b5c5-7b042760a57b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-b1426ca0-1691-4565-8830-8f6b39fe2688 req-8488f881-41cc-4136-a3b1-efd02c1cd499 tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:48 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d Jul 15 18:39:48 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:48 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d Jul 15 18:39:48 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:48 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d" returned: 0 in 0.473s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-605f8250-3139-4ede-8bfd-edf1aeb96b37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:48 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 Jul 15 18:39:48 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:48 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-b1426ca0-1691-4565-8830-8f6b39fe2688 req-8488f881-41cc-4136-a3b1-efd02c1cd499 tempest-AttachVolumeNegativeTest-1381542441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d" returned: 0 in 0.518s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-b1426ca0-1691-4565-8830-8f6b39fe2688 req-8488f881-41cc-4136-a3b1-efd02c1cd499 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.539s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-b1426ca0-1691-4565-8830-8f6b39fe2688 req-8488f881-41cc-4136-a3b1-efd02c1cd499 tempest-AttachVolumeNegativeTest-1381542441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-a7823e46-f547-4fb0-9bae-011a4095777d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8943f5f-49c9-4e2a-ba8c-92ce414b3037', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:39:49 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-b1426ca0-1691-4565-8830-8f6b39fe2688 req-8488f881-41cc-4136-a3b1-efd02c1cd499 tempest-AttachVolumeNegativeTest-1381542441 None] attachment_update completed successfully. Jul 15 18:39:49 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0" returned: 0 in 0.513s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:49 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0 Jul 15 18:39:49 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:49 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.c5c39a4d-f875-498a-b03b-1410f20393c0" returned: 0 in 0.314s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-c5c39a4d-f875-498a-b03b-1410f20393c0" released by "_delete_snapshot" :: held 1.905s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-605f8250-3139-4ede-8bfd-edf1aeb96b37" released by "delete_snapshot" :: held 1.941s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:49 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Created reservations ['829c47b6-5a05-4e09-a39d-c137b641e0cf', 'a2b6c36b-7f9f-4495-9253-035733b10bbc', 'f719adbd-ac7d-4b00-94f5-18ee5f6652fc', 'e56292b4-2fad-415d-9413-0970a167c1c5'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:49 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Delete snapshot completed successfully. Jul 15 18:39:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbe2e1f8-9fd4-4b54-9bdd-184947ba4f2b tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-c5c39a4d-f875-498a-b03b-1410f20393c0-delete_snapshot" released by "delete_snapshot" :: held 2.143s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "cinder-eb3d3cab-7879-4be5-8406-a76bb46bd21d-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-eb3d3cab-7879-4be5-8406-a76bb46bd21d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "cinder-quobyte-605f8250-3139-4ede-8bfd-edf1aeb96b37" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-605f8250-3139-4ede-8bfd-edf1aeb96b37" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "cinder-quobyte-eb3d3cab-7879-4be5-8406-a76bb46bd21d" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-eb3d3cab-7879-4be5-8406-a76bb46bd21d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Deleting offline snapshot eb3d3cab-7879-4be5-8406-a76bb46bd21d of volume 605f8250-3139-4ede-8bfd-edf1aeb96b37 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] snapshot_file for this snap is: volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[96171648-b4b3-4ade-a5ad-f64f48ad098b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:50 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d Jul 15 18:39:50 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:50 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d" returned: 0 in 0.403s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-605f8250-3139-4ede-8bfd-edf1aeb96b37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c4c6aa-0a72-45fd-a9ad-da395556f3df]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:50 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 Jul 15 18:39:50 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:51 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37" returned: 0 in 0.388s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:51 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d Jul 15 18:39:51 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:51 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d" returned: 0 in 0.415s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:51 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d Jul 15 18:39:51 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:51 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37.eb3d3cab-7879-4be5-8406-a76bb46bd21d" returned: 0 in 0.330s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-eb3d3cab-7879-4be5-8406-a76bb46bd21d" released by "_delete_snapshot" :: held 1.701s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-605f8250-3139-4ede-8bfd-edf1aeb96b37" released by "delete_snapshot" :: held 1.731s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:51 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Created reservations ['ce89a55f-c6c6-4790-bd78-9505796b8620', 'e0476858-edb4-4a1e-9fc4-d4fdfbd25042', '93e596d1-8a35-474f-abbf-def8d898c165', 'e3f48d81-4430-4bf6-9e40-383385f4f7d1'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:52 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Delete snapshot completed successfully. Jul 15 18:39:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-364faed8-a1a1-4410-a993-3f6fe542c5b4 tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-eb3d3cab-7879-4be5-8406-a76bb46bd21d-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:52 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-0faa6e97-25f1-4940-99b6-387d6ea09db7 req-99cf2c78-1ef3-480d-b74a-e64ef210a5bc tempest-AttachVolumeNegativeTest-1381542441 None] Terminate volume connection completed successfully. Jul 15 18:39:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0faa6e97-25f1-4940-99b6-387d6ea09db7 req-99cf2c78-1ef3-480d-b74a-e64ef210a5bc tempest-AttachVolumeNegativeTest-1381542441 None] Deleting attachment c8943f5f-49c9-4e2a-ba8c-92ce414b3037. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:39:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "cinder-605f8250-3139-4ede-8bfd-edf1aeb96b37-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-605f8250-3139-4ede-8bfd-edf1aeb96b37-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "cinder-quobyte-605f8250-3139-4ede-8bfd-edf1aeb96b37" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-605f8250-3139-4ede-8bfd-edf1aeb96b37" acquired by "delete_volume" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:52 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a74d63-d8d2-43b3-82b1-05b001d1aa30]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:52 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 Jul 15 18:39:52 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:52 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37" returned: 0 in 0.406s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:52 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37 Jul 15 18:39:52 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:53 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-605f8250-3139-4ede-8bfd-edf1aeb96b37" returned: 0 in 0.552s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-quobyte-605f8250-3139-4ede-8bfd-edf1aeb96b37" released by "delete_volume" :: held 1.047s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:53 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Created reservations ['3e203250-9fe5-4bc5-92bd-f1af21f0dd64', '8cae72af-f291-4650-9a0a-af82805aee43', '155dceb2-018b-44b2-97fc-467d8825a715', '56165f93-9c4f-43c5-a758-2b31c75b1b47'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:53 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:39:53 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:54 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.286s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:54 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Deleted volume successfully. Jul 15 18:39:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1fbad41a-b99d-4d7c-b37a-bc756878916c tempest-VolumesSnapshotListTestJSON-1864146118 None] Lock "cinder-605f8250-3139-4ede-8bfd-edf1aeb96b37-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "cinder-a7823e46-f547-4fb0-9bae-011a4095777d-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "cinder-a7823e46-f547-4fb0-9bae-011a4095777d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "cinder-quobyte-a7823e46-f547-4fb0-9bae-011a4095777d" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "cinder-quobyte-a7823e46-f547-4fb0-9bae-011a4095777d" acquired by "delete_volume" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:57 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[166d221b-ee60-4e38-9636-8c5803660beb]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:57 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d Jul 15 18:39:57 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:58 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d" returned: 0 in 0.463s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:58 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d Jul 15 18:39:58 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:58 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a7823e46-f547-4fb0-9bae-011a4095777d" returned: 0 in 0.320s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "cinder-quobyte-a7823e46-f547-4fb0-9bae-011a4095777d" released by "delete_volume" :: held 0.852s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Created reservations ['59b444e9-b0b0-4591-975a-6ecc0ca75536', '50ffb384-39c9-4aff-b4bd-169c4178400c', 'a4fc0f5c-f4a8-492c-a96a-d6945df663ee', 'e07caf2f-50aa-46c4-a12a-1747ae8fdb77'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:58 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:39:58 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Flow 'volume_create_manager' (6c224654-f611-4e02-9a95-c8660282a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272145ee-6d0c-4d7d-99ee-90b60e33019b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "cinder-c1a67324-25fe-4785-bb41-c53f6e069cf4-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272145ee-6d0c-4d7d-99ee-90b60e33019b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-118408145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3107a56c-be15-4245-b3f2-f35f0f18615e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3792b8f406aa49ceaafcce8e3da9f560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:59Z,use_quota=True,user_id='5893eab1df9941bc9d0131605e5fe839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9830494-00af-4893-9417-99a43168f647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9830494-00af-4893-9417-99a43168f647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbccf06-3236-44d6-8eb4-33554c9db740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbccf06-3236-44d6-8eb4-33554c9db740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3107a56c-be15-4245-b3f2-f35f0f18615e', 'volume_name': 'volume-3107a56c-be15-4245-b3f2-f35f0f18615e', 'volume_size': 2}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb8432e-b178-4f45-afc9-ed7bacf8eaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb8432e-b178-4f45-afc9-ed7bacf8eaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72689fee-d521-4f96-9cc3-368ba6b95dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:59 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Volume 3107a56c-be15-4245-b3f2-f35f0f18615e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3107a56c-be15-4245-b3f2-f35f0f18615e', 'volume_size': 2} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-118408145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3107a56c-be15-4245-b3f2-f35f0f18615e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3792b8f406aa49ceaafcce8e3da9f560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:39:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:39:59Z,use_quota=True,user_id='5893eab1df9941bc9d0131605e5fe839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Creating volume 3107a56c-be15-4245-b3f2-f35f0f18615e {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:39:59 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e 2147483648 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Lock "cinder-c1a67324-25fe-4785-bb41-c53f6e069cf4-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:59 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e 2147483648 Jul 15 18:39:59 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "cinder-quobyte-c1a67324-25fe-4785-bb41-c53f6e069cf4" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:39:59 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.399s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:39:59 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Deleted volume successfully. Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Lock "cinder-quobyte-c1a67324-25fe-4785-bb41-c53f6e069cf4" acquired by "delete_volume" :: waited 0.035s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-eb73987a-f150-4fe8-8a4c-75059fa7e807 tempest-AttachVolumeNegativeTest-1381542441 None] Lock "cinder-a7823e46-f547-4fb0-9bae-011a4095777d-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db4e04-a527-4e57-882f-5323bd0f1919]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:59 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4 Jul 15 18:39:59 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:59 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4" returned: 0 in 0.405s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:59 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e 2147483648" returned: 0 in 0.565s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:59 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4 Jul 15 18:39:59 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:39:59 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e Jul 15 18:39:59 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:39:59 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c1a67324-25fe-4785-bb41-c53f6e069cf4" returned: 0 in 0.330s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:59 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e" returned: 0 in 0.276s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Lock "cinder-quobyte-c1a67324-25fe-4785-bb41-c53f6e069cf4" released by "delete_volume" :: held 0.795s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72689fee-d521-4f96-9cc3-368ba6b95dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3107a56c-be15-4245-b3f2-f35f0f18615e', 'volume_size': 2}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a032bd20-02f1-49ca-8a2b-7bd85bba32ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:39:59 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Volume volume-3107a56c-be15-4245-b3f2-f35f0f18615e (3107a56c-be15-4245-b3f2-f35f0f18615e): created successfully Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a032bd20-02f1-49ca-8a2b-7bd85bba32ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:39:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Flow 'volume_create_manager' (6c224654-f611-4e02-9a95-c8660282a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:00 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-356d0ac4-755b-4295-9839-9f01839c9a23 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Created volume successfully. Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Created reservations ['96a24566-ce33-4941-9654-2a0874bb7799', 'f85f42e4-c607-4dcf-a561-7b20fc504d2d', '14fbd44f-924c-46b9-b292-b5e4e9888935', 'd1866d8d-b7e7-4bf2-b3af-a31763186e25'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:00 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:40:00 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "cinder-02f7118b-f924-4247-af27-8ea04f42b797-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Lock "cinder-02f7118b-f924-4247-af27-8ea04f42b797-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:00 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.382s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:00 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Deleted volume successfully. Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "cinder-quobyte-02f7118b-f924-4247-af27-8ea04f42b797" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-081703b0-ca24-489b-a7c6-e0035c11db7c tempest-AttachVolumeNegativeTest-1381542441 None] Lock "cinder-c1a67324-25fe-4785-bb41-c53f6e069cf4-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Lock "cinder-quobyte-02f7118b-f924-4247-af27-8ea04f42b797" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d88402-e6ed-427a-881a-7134b86d83cc]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:00 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797 Jul 15 18:40:00 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:01 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797" returned: 0 in 0.454s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:01 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797 Jul 15 18:40:01 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Creating offline snapshot ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb of volume 3107a56c-be15-4245-b3f2-f35f0f18615e {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b139cb-0da9-4214-ad7f-e5847c10aa43]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:01 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-02f7118b-f924-4247-af27-8ea04f42b797" returned: 0 in 0.306s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Lock "cinder-quobyte-02f7118b-f924-4247-af27-8ea04f42b797" released by "delete_volume" :: held 0.813s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:01 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e Jul 15 18:40:01 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Created reservations ['3da11847-97d3-4985-9004-905039219c26', 'e7b90ace-1345-4723-9d03-312bc49cd534', '67b99fce-adb6-4f7c-a2a4-a43044de83ff', 'b947a2b0-37d1-41a1-938b-bbc2e15d9aaf'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:01 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:40:01 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:01 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e" returned: 0 in 0.500s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb 2G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:01 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb 2G Jul 15 18:40:01 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:02 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.428s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:02 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:02 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Deleted volume successfully. Jul 15 18:40:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4603b5f8-de93-4f8a-9f28-9d92a6ad8d7d tempest-AttachVolumeNegativeTest-1381542441 None] Lock "cinder-02f7118b-f924-4247-af27-8ea04f42b797-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:02 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb 2G" returned: 0 in 0.586s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3107a56c-be15-4245-b3f2-f35f0f18615e -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:02 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3107a56c-be15-4245-b3f2-f35f0f18615e -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb Jul 15 18:40:02 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:02 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3107a56c-be15-4245-b3f2-f35f0f18615e -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb" returned: 0 in 0.381s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:02 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb is being set with open permissions: ugo+rw Jul 15 18:40:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:02 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb Jul 15 18:40:02 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:03 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb" returned: 0 in 0.275s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:03 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.info Jul 15 18:40:03 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:03 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.info" returned: 0 in 0.286s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:03 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.info is being set with open permissions: ugo+rw Jul 15 18:40:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:03 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.info Jul 15 18:40:03 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:03 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.info" returned: 0 in 0.261s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.394s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:03 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=106,cinder:UPDATE=102,cinder:INSERT=37,cinder:DELETE=7 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:40:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-386f5e07-12e0-4b4f-9583-bc04a3b65ec8 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Create snapshot completed successfully Jul 15 18:40:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Acquiring lock "cinder-ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "cinder-ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Acquiring lock "cinder-quobyte-3107a56c-be15-4245-b3f2-f35f0f18615e" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "cinder-quobyte-3107a56c-be15-4245-b3f2-f35f0f18615e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Acquiring lock "cinder-quobyte-ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "cinder-quobyte-ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:04 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Deleting offline snapshot ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb of volume 3107a56c-be15-4245-b3f2-f35f0f18615e {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:40:04 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] snapshot_file for this snap is: volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:40:04 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4b7961-1681-4d08-b0eb-f1b799d4b96a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:04 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb Jul 15 18:40:04 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:05 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb" returned: 0 in 0.418s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3107a56c-be15-4245-b3f2-f35f0f18615e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:40:05 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[7073219b-2039-4028-86ed-53a5f54ba3c9]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:05 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e Jul 15 18:40:05 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:05 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e" returned: 0 in 0.471s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:05 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb Jul 15 18:40:05 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:06 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb" returned: 0 in 0.469s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:06 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb Jul 15 18:40:06 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:06 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e.ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb" returned: 0 in 0.309s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "cinder-quobyte-ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb" released by "_delete_snapshot" :: held 1.812s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "cinder-quobyte-3107a56c-be15-4245-b3f2-f35f0f18615e" released by "delete_snapshot" :: held 1.839s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Created reservations ['3c6edd16-7d3a-4c65-8d17-7b2691f71e62', '76c756d8-4820-4628-ae7e-787ba537c08c', '0fa8e262-bdd3-4181-92aa-8329a8110b6c', 'f40d858a-8759-40d8-b9d5-b546cfe9f639'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:06 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Delete snapshot completed successfully. Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5dbf23bb-1ce0-465a-9ad7-dfea54df5599 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "cinder-ee67eed6-4e6d-4a2d-bb8e-f6dde42cccfb-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Acquiring lock "cinder-3107a56c-be15-4245-b3f2-f35f0f18615e-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "cinder-3107a56c-be15-4245-b3f2-f35f0f18615e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Acquiring lock "cinder-quobyte-3107a56c-be15-4245-b3f2-f35f0f18615e" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "cinder-quobyte-3107a56c-be15-4245-b3f2-f35f0f18615e" acquired by "delete_volume" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e08d97-50c1-4dc9-8ddb-d78fe958dd44]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:07 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e Jul 15 18:40:07 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:07 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e" returned: 0 in 0.510s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:07 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e Jul 15 18:40:07 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:07 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3107a56c-be15-4245-b3f2-f35f0f18615e" returned: 0 in 0.286s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:07 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "cinder-quobyte-3107a56c-be15-4245-b3f2-f35f0f18615e" released by "delete_volume" :: held 0.873s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:07 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Created reservations ['3a18a4ec-2b06-4a77-8c8c-ed71a7f0f453', 'c41f212d-880c-42a4-ab3b-5b98dfb85065', 'e8372c9b-212a-4444-a66a-23b5e30cd143', '0f86448f-06ae-470e-b458-9db74b49795e'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:07 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:40:07 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:08 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.343s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:08 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:08 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Deleted volume successfully. Jul 15 18:40:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-705b3a40-07e9-43cc-b276-b306b1117b13 tempest-VolumesSnapshotNegativeTestJSON-298686420 None] Lock "cinder-3107a56c-be15-4245-b3f2-f35f0f18615e-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Flow 'volume_create_manager' (321c3040-3290-4f62-aecb-4fb169766137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b4b8aa-b7bb-45b5-8c2d-f2ac074d70a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b4b8aa-b7bb-45b5-8c2d-f2ac074d70a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-86267244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5287c700-9af1-49aa-8213-e8e68d6ecf0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5430a1f8e17b4f16ade230654126b4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:11Z,use_quota=True,user_id='efed502f6d074d09becac41dd7fa58cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36940ba4-8ef7-4f4a-ba98-8d0d6df26453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36940ba4-8ef7-4f4a-ba98-8d0d6df26453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1857646f-3687-4124-8263-320813945fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1857646f-3687-4124-8263-320813945fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5287c700-9af1-49aa-8213-e8e68d6ecf0d', 'volume_name': 'volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8cd8a8a-5136-4f8e-b860-afa2cd6c5956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8cd8a8a-5136-4f8e-b860-afa2cd6c5956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f279c1bb-53f4-4359-a885-1b9474b5e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:11 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Volume 5287c700-9af1-49aa-8213-e8e68d6ecf0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d', 'volume_size': 1} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-86267244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5287c700-9af1-49aa-8213-e8e68d6ecf0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5430a1f8e17b4f16ade230654126b4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:11Z,use_quota=True,user_id='efed502f6d074d09becac41dd7fa58cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Creating volume 5287c700-9af1-49aa-8213-e8e68d6ecf0d {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:40:11 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:11 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d 1073741824 Jul 15 18:40:11 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:11 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d 1073741824" returned: 0 in 0.535s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:12 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d Jul 15 18:40:12 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:12 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d" returned: 0 in 0.310s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:40:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f279c1bb-53f4-4359-a885-1b9474b5e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028887df-0777-4fd3-9f96-039058693a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:12 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Volume volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d (5287c700-9af1-49aa-8213-e8e68d6ecf0d): created successfully Jul 15 18:40:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028887df-0777-4fd3-9f96-039058693a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Flow 'volume_create_manager' (321c3040-3290-4f62-aecb-4fb169766137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:12 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-e05f443f-3ff1-4f29-97b0-b917dc5ca78d req-ae6c5279-1fad-4580-8cd0-34bc90cadf54 tempest-VolumesGetTestJSON-1815540446 None] Created volume successfully. Jul 15 18:40:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Acquiring lock "cinder-5287c700-9af1-49aa-8213-e8e68d6ecf0d-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Lock "cinder-5287c700-9af1-49aa-8213-e8e68d6ecf0d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Acquiring lock "cinder-quobyte-5287c700-9af1-49aa-8213-e8e68d6ecf0d" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Lock "cinder-quobyte-5287c700-9af1-49aa-8213-e8e68d6ecf0d" acquired by "delete_volume" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:13 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8b7bba-53a9-409b-abdd-d6d256712c42]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:14 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d Jul 15 18:40:14 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:14 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d" returned: 0 in 0.367s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:14 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d Jul 15 18:40:14 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:14 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5287c700-9af1-49aa-8213-e8e68d6ecf0d" returned: 0 in 0.307s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Lock "cinder-quobyte-5287c700-9af1-49aa-8213-e8e68d6ecf0d" released by "delete_volume" :: held 0.732s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:14 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=105,cinder:INSERT=31,cinder:UPDATE=133,cinder:DELETE=11 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:40:14 devstack cinder-volume[87217]: DEBUG cinder.quota [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Created reservations ['9cb3e733-62ea-45ff-a6ba-3c6493276064', 'e766263b-9542-401b-9005-757ba319c86a', '37b244bf-b87c-46ad-9a9d-07df4040a36d', 'e6b95d43-7ef5-4a29-a22d-734b4627984f'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:14 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:40:14 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:15 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.305s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.manager [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:15 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Deleted volume successfully. Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-b0a49017-6862-4453-b9fe-197886c3b36f req-35df3493-a4ea-4b01-af17-e924d3ad552f tempest-VolumesGetTestJSON-1815540446 None] Lock "cinder-5287c700-9af1-49aa-8213-e8e68d6ecf0d-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Flow 'volume_create_manager' (c72aa4a3-3f31-4fdf-a456-df065563d9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3166a7c1-8252-40c2-b9ba-9b4f8618afcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3166a7c1-8252-40c2-b9ba-9b4f8618afcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-823803648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff6634c-2f9a-498c-ba7e-b85e6d4354f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb814acb961478bbc6ae1e87e04aa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:15Z,use_quota=True,user_id='72ae8c34d2204a58bae985bb0106c42b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df72d88c-99a2-4034-bdec-ef9344ce4ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df72d88c-99a2-4034-bdec-ef9344ce4ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c7dcd5-39c7-4308-b8b4-7b01d2e32f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c7dcd5-39c7-4308-b8b4-7b01d2e32f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ff6634c-2f9a-498c-ba7e-b85e6d4354f7', 'volume_name': 'volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f75f663-14ff-42fb-9409-361c56c09b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f75f663-14ff-42fb-9409-361c56c09b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f2d61f-dc8f-46bb-ab25-0ae4190e828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:15 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Volume 2ff6634c-2f9a-498c-ba7e-b85e6d4354f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7', 'volume_size': 1} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-823803648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff6634c-2f9a-498c-ba7e-b85e6d4354f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb814acb961478bbc6ae1e87e04aa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:15Z,use_quota=True,user_id='72ae8c34d2204a58bae985bb0106c42b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Creating volume 2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:40:15 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:40:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:15 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 1073741824 Jul 15 18:40:15 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:16 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 1073741824" returned: 0 in 0.584s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:16 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 Jul 15 18:40:16 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:16 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" returned: 0 in 0.278s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:40:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f2d61f-dc8f-46bb-ab25-0ae4190e828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a9daa7-4c58-48f5-bb1f-41b7f1c589c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:16 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Volume volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 (2ff6634c-2f9a-498c-ba7e-b85e6d4354f7): created successfully Jul 15 18:40:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a9daa7-4c58-48f5-bb1f-41b7f1c589c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Flow 'volume_create_manager' (c72aa4a3-3f31-4fdf-a456-df065563d9c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:16 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1692677f-8746-4d87-979c-eb0be46bd7d5 tempest-TestStampPattern-729832931 None] Created volume successfully. Jul 15 18:40:26 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=23,cinder:INSERT=9,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:40:26 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:INSERT=1,cinder:UPDATE=8,cinder:SELECT=3,cinder:DELETE=2 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:40:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f73fe0d1-dc56-4b4e-b43f-0740c5963b01 tempest-BackendsCapabilitiesAdminTestsJSON-177114234 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5915908813477, 'free_capacity_gb': 1775.5915908813477, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87217) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 15 18:40:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-560f5c4a-74ce-49a5-83db-b8b6ef8bad51 tempest-BackendsCapabilitiesAdminTestsJSON-177114234 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5915908813477, 'free_capacity_gb': 1775.5915908813477, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87217) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 15 18:40:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:40:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:40:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:40:36 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-13c433b3-f46a-41c4-92e3-3a62ecd77d31 tempest-GroupSnapshotsTest-2000156750 None] Group tempest-GroupSnapshotsTest-Group-240117369: creating Jul 15 18:40:36 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-13c433b3-f46a-41c4-92e3-3a62ecd77d31 tempest-GroupSnapshotsTest-2000156750 None] Group tempest-GroupSnapshotsTest-Group-240117369: created successfully Jul 15 18:40:36 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-13c433b3-f46a-41c4-92e3-3a62ecd77d31 tempest-GroupSnapshotsTest-2000156750 None] Create group completed successfully. Jul 15 18:40:37 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:40:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Flow 'volume_create_manager' (a2faf56b-9de8-42db-99a3-08aeb2d67218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb63b93-a3ea-465d-a188-34879c1d78e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb63b93-a3ea-465d-a188-34879c1d78e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1748492140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1dccd680-f553-49c0-89e7-eb7be075cece,host='devstack@QuobyteHD#QuobyteHD',id=e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5b53a35b34413a806611d645ae98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:38Z,use_quota=True,user_id='2274d1f2b7774bd89d07a93c7dce102e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f28c75f1-338c-4a90-bd76-643f2a46cd17),volume_type_id=f28c75f1-338c-4a90-bd76-643f2a46cd17)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dde7ffb-9555-48fb-beda-9af9bf461f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dde7ffb-9555-48fb-beda-9af9bf461f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98fb2ae3-56aa-4639-9984-a875f599c5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98fb2ae3-56aa-4639-9984-a875f599c5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151', 'volume_name': 'volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3759d57f-4fb2-463d-8e51-079465fc8816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3759d57f-4fb2-463d-8e51-079465fc8816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29c4d63-368c-4f87-aaa1-993ad54f7a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:38 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Volume e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151', 'volume_size': 1} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1dccd680-f553-49c0-89e7-eb7be075cece,created_at=2026-07-15T16:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1748492140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1dccd680-f553-49c0-89e7-eb7be075cece,host='devstack@QuobyteHD#QuobyteHD',id=e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5b53a35b34413a806611d645ae98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:38Z,use_quota=True,user_id='2274d1f2b7774bd89d07a93c7dce102e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f28c75f1-338c-4a90-bd76-643f2a46cd17),volume_type_id=f28c75f1-338c-4a90-bd76-643f2a46cd17)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Creating volume e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:40:38 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:38 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 1073741824 Jul 15 18:40:38 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:38 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 1073741824" returned: 0 in 0.549s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:38 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 Jul 15 18:40:38 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:38 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" returned: 0 in 0.292s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29c4d63-368c-4f87-aaa1-993ad54f7a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897423af-4580-4d9f-9df1-ef99419cb7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:38 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Volume volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 (e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151): created successfully Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897423af-4580-4d9f-9df1-ef99419cb7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Flow 'volume_create_manager' (a2faf56b-9de8-42db-99a3-08aeb2d67218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:38 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0293df53-c83b-45bc-a1af-a4111e3b58cf tempest-GroupSnapshotsTest-2000156750 None] Created volume successfully. Jul 15 18:40:40 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] GroupSnapshot d04f8d7c-47ec-407f-a59f-96b388908c64: creating. Jul 15 18:40:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] Group snapshot d04f8d7c-47ec-407f-a59f-96b388908c64: creating. {{(pid=87217) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 15 18:40:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] Creating offline snapshot 9d95e1f9-f5cd-45cd-a006-a84a081438f2 of volume e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:40:40 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60e1863-61f8-4783-ba52-749703aa4276]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:40 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 Jul 15 18:40:40 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:40 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" returned: 0 in 0.400s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:41 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 1G Jul 15 18:40:41 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Flow 'volume_create_manager' (0a669c98-9dd0-4224-9f0f-f322ac5a3ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac12055-64e4-476e-9fda-008feddb39e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:41 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 1G" returned: 0 in 0.489s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac12055-64e4-476e-9fda-008feddb39e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-810892580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d577e18616465aac16a835c39e0c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:41Z,use_quota=True,user_id='7cdf4ae696f24c158a537e025c993d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c865e95d-7174-4033-8a9b-21ac113c6911),volume_type_id=c865e95d-7174-4033-8a9b-21ac113c6911)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:41 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 Jul 15 18:40:41 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad52cec-449a-4a33-839d-53d9a13261b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad52cec-449a-4a33-839d-53d9a13261b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09baf04-4365-4ec0-a2af-8051221e095a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09baf04-4365-4ec0-a2af-8051221e095a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c0f53a-5a25-4f74-a7dd-058c09fc4ef4', 'volume_name': 'volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226fd20d-cc00-422e-8c5c-4232fedfb544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226fd20d-cc00-422e-8c5c-4232fedfb544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d60a6c-4bec-41e3-a822-049cd60be07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:41 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Volume d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4', 'volume_size': 1} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:41 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2" returned: 0 in 0.357s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:41 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:40:41 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 Jul 15 18:40:41 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Flow 'volume_create_manager' (f628f89e-865c-41ab-ad3f-747b572a99b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01f3d57-4efb-4882-9532-2bcf3c7d564a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01f3d57-4efb-4882-9532-2bcf3c7d564a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-840036264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114550e5-c405-49f5-ac13-cf9d07999119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d577e18616465aac16a835c39e0c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:42Z,use_quota=True,user_id='7cdf4ae696f24c158a537e025c993d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77b4623d-446c-406a-8235-d0a79bb3124a),volume_type_id=77b4623d-446c-406a-8235-d0a79bb3124a)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7911bd-24df-4074-8a05-ea082522dc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7911bd-24df-4074-8a05-ea082522dc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c38384b-f387-4e54-adac-2cd972b180bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c38384b-f387-4e54-adac-2cd972b180bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114550e5-c405-49f5-ac13-cf9d07999119', 'volume_name': 'volume-114550e5-c405-49f5-ac13-cf9d07999119', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ef04ea-7316-4f3a-a0da-fe68752daa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ef04ea-7316-4f3a-a0da-fe68752daa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7464481-de67-41a7-980e-6c8a9f490f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:41 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Volume 114550e5-c405-49f5-ac13-cf9d07999119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114550e5-c405-49f5-ac13-cf9d07999119', 'volume_size': 1} Jul 15 18:40:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:42 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2" returned: 0 in 0.261s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:42 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.info Jul 15 18:40:42 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:42 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.info" returned: 0 in 0.289s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:42 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.info is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:42 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.info Jul 15 18:40:42 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Flow 'volume_create_manager' (32c4e368-7a9b-4302-b3b3-a00bb486c928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c30bb52-605d-471b-b5c0-f65c81a8d2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c30bb52-605d-471b-b5c0-f65c81a8d2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1524081437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66e9977-1149-48df-937e-98b5996382ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d577e18616465aac16a835c39e0c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:42Z,use_quota=True,user_id='7cdf4ae696f24c158a537e025c993d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcddc174-bb1d-40c7-b123-d4a1446f3b39),volume_type_id=bcddc174-bb1d-40c7-b123-d4a1446f3b39)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54075000-a3b4-44cd-9730-b2533414591b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54075000-a3b4-44cd-9730-b2533414591b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c228cc2d-004f-40a6-b6a1-4cc281efd4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.image.glance [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Creating Keystone auth plugin from conf {{(pid=87217) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:40:42 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.info" returned: 0 in 0.283s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.160s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-810892580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d577e18616465aac16a835c39e0c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:41Z,use_quota=True,user_id='7cdf4ae696f24c158a537e025c993d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c865e95d-7174-4033-8a9b-21ac113c6911),volume_type_id=c865e95d-7174-4033-8a9b-21ac113c6911)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Creating volume d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:40:42 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:42 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 1073741824 Jul 15 18:40:42 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:42 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-51df7f20-8740-4b79-8ac7-2c5934b658d3 tempest-GroupSnapshotsTest-2000156750 None] group_snapshot d04f8d7c-47ec-407f-a59f-96b388908c64: created successfully Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c228cc2d-004f-40a6-b6a1-4cc281efd4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b66e9977-1149-48df-937e-98b5996382ea', 'volume_name': 'volume-b66e9977-1149-48df-937e-98b5996382ea', 'volume_size': 1, 'image_id': '2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--742983647', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '69d577e18616465aac16a835c39e0c50', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'created_at': datetime.datetime(2026, 7, 15, 16, 40, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 40, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37/file', 'properties': {}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2bbd70-4d66-4501-9d8f-ddc54244a92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2bbd70-4d66-4501-9d8f-ddc54244a92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8638b6-8289-47fe-bb89-1e3432dcbc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:42 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Volume b66e9977-1149-48df-937e-98b5996382ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b66e9977-1149-48df-937e-98b5996382ea', 'volume_size': 1, 'image_id': '2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--742983647', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '69d577e18616465aac16a835c39e0c50', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'created_at': datetime.datetime(2026, 7, 15, 16, 40, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 40, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37/file', 'properties': {}}, 'image_service': } Jul 15 18:40:42 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Trying to clone b66e9977-1149-48df-937e-98b5996382ea from image 2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'metadata': {}}]). {{(pid=87217) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:40:43 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 1073741824" returned: 0 in 0.454s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:43 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 Jul 15 18:40:43 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:43 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4" returned: 0 in 0.243s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-840036264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114550e5-c405-49f5-ac13-cf9d07999119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d577e18616465aac16a835c39e0c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:42Z,use_quota=True,user_id='7cdf4ae696f24c158a537e025c993d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77b4623d-446c-406a-8235-d0a79bb3124a),volume_type_id=77b4623d-446c-406a-8235-d0a79bb3124a)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Creating volume 114550e5-c405-49f5-ac13-cf9d07999119 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:40:43 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:43 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119 1073741824 Jul 15 18:40:43 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d60a6c-4bec-41e3-a822-049cd60be07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474156d1-0cb6-4180-937a-a83eb13e4380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:43 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Volume volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 (d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4): created successfully Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474156d1-0cb6-4180-937a-a83eb13e4380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Flow 'volume_create_manager' (0a669c98-9dd0-4224-9f0f-f322ac5a3ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:43 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-088d7aaa-e7f2-4747-8714-2387e4f377f8 tempest-TestInstancesWithCinderVolumes-1397700888 None] Created volume successfully. Jul 15 18:40:43 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119 1073741824" returned: 0 in 0.470s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:44 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119 Jul 15 18:40:44 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:44 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119" returned: 0 in 0.292s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7464481-de67-41a7-980e-6c8a9f490f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114550e5-c405-49f5-ac13-cf9d07999119', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700cd76e-d31e-45d1-8889-20737e26a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:44 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Volume volume-114550e5-c405-49f5-ac13-cf9d07999119 (114550e5-c405-49f5-ac13-cf9d07999119): created successfully Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700cd76e-d31e-45d1-8889-20737e26a19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Flow 'volume_create_manager' (f628f89e-865c-41ab-ad3f-747b572a99b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:44 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e4c87556-cb77-446d-9d24-87fc7184ddd3 tempest-TestInstancesWithCinderVolumes-1397700888 None] Created volume successfully. Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-9d95e1f9-f5cd-45cd-a006-a84a081438f2-313377d1-3ebe-41a4-aabf-7b93424846e5" by "_create_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-9d95e1f9-f5cd-45cd-a006-a84a081438f2-313377d1-3ebe-41a4-aabf-7b93424846e5" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Creating volume 313377d1-3ebe-41a4-aabf-7b93424846e5 from snapshot 9d95e1f9-f5cd-45cd-a006-a84a081438f2 {{(pid=87217) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-313377d1-3ebe-41a4-aabf-7b93424846e5" by "_copy_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-313377d1-3ebe-41a4-aabf-7b93424846e5" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] snapshot: 9d95e1f9-f5cd-45cd-a006-a84a081438f2, volume: 313377d1-3ebe-41a4-aabf-7b93424846e5, {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4a1b82-a732-4ab3-ac91-e46353896572]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:44 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 Jul 15 18:40:44 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:45 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2" returned: 0 in 0.478s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:40:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:40:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Creating direct copy from snapshot {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:40:45 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[0296ad1e-f8ee-45fd-b02a-697735260cdd]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:45 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 Jul 15 18:40:45 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:45 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" returned: 0 in 0.449s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:45 devstack cinder-volume[87217]: DEBUG cinder.utils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Path /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5 not found in is_blk_device check {{(pid=87217) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:40:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:45 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5 Jul 15 18:40:45 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:47 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD, size 20.69 MB, duration 4.23 sec {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:40:47 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Image download 20.69 MB at 4.89 MB/s Jul 15 18:40:47 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6acd192-7bdb-44e5-9ea2-591e2a2e4230]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:47 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD Jul 15 18:40:47 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:47 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD" returned: 0 in 0.627s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:47 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Temporary image 2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37 is fetched for user 7cdf4ae696f24c158a537e025c993d2b. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:40:47 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef5dfc2-f458-412b-bcbd-1f5a4286aaad]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:48 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD Jul 15 18:40:48 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:48 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD" returned: 0 in 0.562s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:50 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5" returned: 0 in 4.791s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:50 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[606c5099-1b16-47d6-bb05-8921584a561f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:50 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 Jul 15 18:40:50 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:51 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" returned: 0 in 0.548s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5 {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:40:51 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Converted 1024.00 MB image at 213.67 MB/s Jul 15 18:40:51 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5 is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:51 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5 Jul 15 18:40:51 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-789d19fb-70c6-413d-9e5c-1d3cbdc4044a req-6ea89276-71d0-48de-b063-4160707cc19f tempest-TestStampPattern-729832931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:51 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5" returned: 0 in 0.260s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-313377d1-3ebe-41a4-aabf-7b93424846e5" released by "_copy_volume_from_snapshot" :: held 6.656s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-9d95e1f9-f5cd-45cd-a006-a84a081438f2-313377d1-3ebe-41a4-aabf-7b93424846e5" released by "_create_volume_from_snapshot" :: held 6.699s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.719s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.791s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1524081437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66e9977-1149-48df-937e-98b5996382ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d577e18616465aac16a835c39e0c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:40:42Z,use_quota=True,user_id='7cdf4ae696f24c158a537e025c993d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcddc174-bb1d-40c7-b123-d4a1446f3b39),volume_type_id=bcddc174-bb1d-40c7-b123-d4a1446f3b39)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Creating volume b66e9977-1149-48df-937e-98b5996382ea {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:40:51 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:51 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea 1073741824 Jul 15 18:40:51 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:51 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6e0a1983-1088-47c7-82b6-3653035ae69c tempest-GroupSnapshotsTest-2000156750 None] Create group from source-snapshot-d04f8d7c-47ec-407f-a59f-96b388908c64 completed successfully. Jul 15 18:40:51 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea 1073741824" returned: 0 in 0.421s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:51 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea Jul 15 18:40:51 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:52 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea" returned: 0 in 0.261s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-789d19fb-70c6-413d-9e5c-1d3cbdc4044a req-6ea89276-71d0-48de-b063-4160707cc19f tempest-TestStampPattern-729832931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.942s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[79884056-7984-4769-91d9-5fb5c386135d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-789d19fb-70c6-413d-9e5c-1d3cbdc4044a req-6ea89276-71d0-48de-b063-4160707cc19f tempest-TestStampPattern-729832931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Attempting download of 2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'metadata': {}}])) to volume b66e9977-1149-48df-937e-98b5996382ea. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6d8a2f-0dd7-43d4-a478-d0f3b686b143]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_i3p6roeq {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:52 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 Jul 15 18:40:52 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:52 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_i3p6roeq Jul 15 18:40:52 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:52 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-789d19fb-70c6-413d-9e5c-1d3cbdc4044a req-6ea89276-71d0-48de-b063-4160707cc19f tempest-TestStampPattern-729832931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" returned: 0 in 0.411s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-789d19fb-70c6-413d-9e5c-1d3cbdc4044a req-6ea89276-71d0-48de-b063-4160707cc19f tempest-TestStampPattern-729832931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.435s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:52 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_i3p6roeq" returned: 0 in 0.359s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_i3p6roeq {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-789d19fb-70c6-413d-9e5c-1d3cbdc4044a req-6ea89276-71d0-48de-b063-4160707cc19f tempest-TestStampPattern-729832931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99218dd2-15ae-4bba-9743-c7f0262004f9', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:40:52 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-789d19fb-70c6-413d-9e5c-1d3cbdc4044a req-6ea89276-71d0-48de-b063-4160707cc19f tempest-TestStampPattern-729832931 None] attachment_update completed successfully. Jul 15 18:40:52 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_i3p6roeq Jul 15 18:40:52 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:52 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_i3p6roeq" returned: 1 in 0.383s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_i3p6roeq' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[af461870-6b2e-48b9-a557-4b9172b8d2c4]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-313377d1-3ebe-41a4-aabf-7b93424846e5" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-313377d1-3ebe-41a4-aabf-7b93424846e5" acquired by "delete_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:53 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6c01d4-07f5-4611-ad1f-f1915159f4ab]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:53 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD Jul 15 18:40:53 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:53 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5 Jul 15 18:40:53 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:53 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:53 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] 2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37 was qcow2, converting to raw {{(pid=87217) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:40:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:53 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea Jul 15 18:40:53 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:53 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5" returned: 0 in 0.461s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:53 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5 Jul 15 18:40:53 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:53 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-313377d1-3ebe-41a4-aabf-7b93424846e5" returned: 0 in 0.308s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-313377d1-3ebe-41a4-aabf-7b93424846e5" released by "delete_volume" :: held 0.835s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:53 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['b541d287-a08a-469b-accb-c279db4b2f68'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:53 devstack cinder-volume[87217]: WARNING cinder.quota [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1747426545 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1747426545, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:40:53 devstack cinder-volume[87217]: WARNING cinder.quota [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1747426545 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1747426545, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:40:53 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['44ce409d-d5b5-4eff-91fc-98086fce0480', '73ced7bb-c492-4fef-afde-e73f35bf1422', '3f0d2b9a-7982-4eac-a0bb-3bff51af182b', 'f05fd26d-fcf5-425b-b542-2aa12e7fa1df'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:54 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:40:54 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] group_snapshot d04f8d7c-47ec-407f-a59f-96b388908c64: deleting Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] group_snapshot d04f8d7c-47ec-407f-a59f-96b388908c64: deleting {{(pid=87217) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-9d95e1f9-f5cd-45cd-a006-a84a081438f2" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-9d95e1f9-f5cd-45cd-a006-a84a081438f2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Deleting offline snapshot 9d95e1f9-f5cd-45cd-a006-a84a081438f2 of volume e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] snapshot_file for this snap is: volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3164d3-039f-416f-88ec-c943b01694cd]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:54 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.355s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-374bbf14-e181-4a37-b7a9-4a3dd14da554 tempest-GroupSnapshotsTest-2000156750 None] Delete group completed successfully. Jul 15 18:40:54 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 Jul 15 18:40:54 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:54 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2" returned: 0 in 0.475s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e08735-7416-433f-b008-c2978b886e38]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:55 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 Jul 15 18:40:55 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:55 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea" returned: 0 in 1.883s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:55 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37_4amzck_9devstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:40:55 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Converted 112.00 MB image at 59.44 MB/s Jul 15 18:40:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:55 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea 1G Jul 15 18:40:55 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:55 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" returned: 0 in 0.385s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:55 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 Jul 15 18:40:55 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:55 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea 1G" returned: 0 in 0.337s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:55 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[8163067e-1213-4500-a394-66740a08bdc3]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:55 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea Jul 15 18:40:55 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:55 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2" returned: 0 in 0.401s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:55 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2 Jul 15 18:40:55 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:55 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea" returned: 0 in 0.382s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:56 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151.9d95e1f9-f5cd-45cd-a006-a84a081438f2" returned: 0 in 0.271s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-9d95e1f9-f5cd-45cd-a006-a84a081438f2" released by "_delete_snapshot" :: held 1.659s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" released by "delete_snapshot" :: held 1.685s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:56 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea Jul 15 18:40:56 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:56 devstack cinder-volume[87217]: WARNING cinder.quota [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1747426545 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1747426545, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['c41a6ff8-2b7b-4216-908c-77cc2225b202', '158bb77b-3ea8-4930-839e-171a2714efd7', 'e10dd4e0-fd05-4437-b1ed-884ef44d91dd', '64e01794-cb91-413e-87e6-19aa8dadba26'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:56 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0e1fac1c-5235-446b-be3c-4a99ec0f5145 tempest-GroupSnapshotsTest-2000156750 None] group_snapshot d04f8d7c-47ec-407f-a59f-96b388908c64: deleted successfully Jul 15 18:40:56 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea" returned: 1 in 0.394s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Downloaded image 2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'metadata': {}}])) to volume b66e9977-1149-48df-937e-98b5996382ea successfully. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Temporary image 2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37 for user 7cdf4ae696f24c158a537e025c993d2b is deleted. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Marking volume b66e9977-1149-48df-937e-98b5996382ea as bootable. {{(pid=87217) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Copying metadata from image 2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37 to b66e9977-1149-48df-937e-98b5996382ea. {{(pid=87217) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Creating volume glance metadata for volume b66e9977-1149-48df-937e-98b5996382ea backed by image 2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37 with: {'image_id': '2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'image_name': 'tempest-scenario-img--742983647', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87217) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8638b6-8289-47fe-bb89-1e3432dcbc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b66e9977-1149-48df-937e-98b5996382ea', 'volume_size': 1, 'image_id': '2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--742983647', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '69d577e18616465aac16a835c39e0c50', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37', 'created_at': datetime.datetime(2026, 7, 15, 16, 40, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 40, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f6b8e23-7a9f-4f25-9d85-3d6dd8710d37/file', 'properties': {}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ff61e3-ba44-4401-b8a2-adc6d3c2278e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:40:56 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Volume volume-b66e9977-1149-48df-937e-98b5996382ea (b66e9977-1149-48df-937e-98b5996382ea): created successfully Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ff61e3-ba44-4401-b8a2-adc6d3c2278e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Flow 'volume_create_manager' (32c4e368-7a9b-4302-b3b3-a00bb486c928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:40:56 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7a3ddea0-4d5b-4f10-bc64-5705a1b3b6f7 tempest-TestInstancesWithCinderVolumes-1397700888 None] Created volume successfully. Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:40:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" acquired by "delete_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:40:57 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b65e2a-ae0d-4884-9726-2d47168018ed]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:57 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 Jul 15 18:40:57 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:57 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" returned: 0 in 0.428s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:57 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151 Jul 15 18:40:57 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:57 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" returned: 0 in 0.309s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-e30fd2cf-2d97-4ee9-9ed7-e7acc29e6151" released by "delete_volume" :: held 0.825s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:40:57 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-a3ed30b9-a9f4-46d6-a808-bccece89fa77 req-b9436e2c-0620-450a-96c9-e5729469b302 tempest-TestStampPattern-729832931 None] Terminate volume connection completed successfully. Jul 15 18:40:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-a3ed30b9-a9f4-46d6-a808-bccece89fa77 req-b9436e2c-0620-450a-96c9-e5729469b302 tempest-TestStampPattern-729832931 None] Deleting attachment 99218dd2-15ae-4bba-9743-c7f0262004f9. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:40:57 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['844afb52-b525-4a05-86d5-a2563eadd3d0'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:57 devstack cinder-volume[87217]: WARNING cinder.db.api [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1747426545'] Jul 15 18:40:57 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['f119e3f2-1e65-45e9-b8b5-dce9c7405295', '4df610fb-3ee1-4051-880c-7912c2636220', '4e42d009-1cd6-434c-ae27-b8face43fef9', '32c4c439-81fc-447e-9737-243fe3ba6f4d'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:58 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:40:58 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:58 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.361s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:40:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7462335b-7bf5-4f8f-8e5d-045166a60097 tempest-GroupSnapshotsTest-2000156750 None] Delete group completed successfully. Jul 15 18:40:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1b961766-19c1-4702-a493-e7e19c0fb1fe tempest-GroupSnapshotsTest-2000156750 None] Group tempest-GroupSnapshotsTest-Group-11483801: creating Jul 15 18:40:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1b961766-19c1-4702-a493-e7e19c0fb1fe tempest-GroupSnapshotsTest-2000156750 None] Group tempest-GroupSnapshotsTest-Group-11483801: created successfully Jul 15 18:40:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1b961766-19c1-4702-a493-e7e19c0fb1fe tempest-GroupSnapshotsTest-2000156750 None] Create group completed successfully. Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] Creating offline snapshot 80d72ef1-3cd0-44f6-862a-da4a38a4ede7 of volume 2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7afd3b3-dcde-4a1f-9162-0e5e2cb9882f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:40:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:58 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 Jul 15 18:40:58 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:59 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" returned: 0 in 0.388s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:59 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 1G Jul 15 18:40:59 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:40:59 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Jul 15 18:40:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 1G" returned: 0 in 0.646s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:40:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:40:59 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 Jul 15 18:40:59 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-4b963c2d-8c0e-461e-8a40-93a0f1a6f44a req-a8c25427-a4cf-494e-9e35-7c9956283d6f tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:00 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7" returned: 0 in 0.373s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:00 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 is being set with open permissions: ugo+rw Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:00 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 Jul 15 18:41:00 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:00 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7" returned: 0 in 0.415s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Flow 'volume_create_manager' (2cb6f39d-1bba-44ea-968c-a7a6ed24faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6b74a3-49f9-4ca7-a8be-14ef76987110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6b74a3-49f9-4ca7-a8be-14ef76987110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1837634079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db04f443-ec1b-4349-b750-4d1d3f7d1197,host='devstack@QuobyteHD#QuobyteHD',id=1302ae1e-ec4b-4303-8682-284a5e55dbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5b53a35b34413a806611d645ae98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:01Z,use_quota=True,user_id='2274d1f2b7774bd89d07a93c7dce102e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11134910-d652-41ea-b508-49adcd2fc725),volume_type_id=11134910-d652-41ea-b508-49adcd2fc725)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:00 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.info Jul 15 18:41:00 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90220e8-adbd-42fd-9a94-eb8fe73e79fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90220e8-adbd-42fd-9a94-eb8fe73e79fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fabc45c-1605-47fa-a161-83c665932be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fabc45c-1605-47fa-a161-83c665932be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1302ae1e-ec4b-4303-8682-284a5e55dbad', 'volume_name': 'volume-1302ae1e-ec4b-4303-8682-284a5e55dbad', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a9be0b-ae34-4643-a158-075d7f1deb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a9be0b-ae34-4643-a158-075d7f1deb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c3ebc3-e040-435a-aba6-432945479ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:00 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Volume 1302ae1e-ec4b-4303-8682-284a5e55dbad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1302ae1e-ec4b-4303-8682-284a5e55dbad', 'volume_size': 1} Jul 15 18:41:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:01 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.info" returned: 0 in 0.296s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:01 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.info is being set with open permissions: ugo+rw Jul 15 18:41:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:01 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.info Jul 15 18:41:01 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:01 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.info" returned: 0 in 0.244s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-4b963c2d-8c0e-461e-8a40-93a0f1a6f44a req-a8c25427-a4cf-494e-9e35-7c9956283d6f tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.268s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:01 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7241bf76-7b15-4d21-aeda-d77c23163c58 tempest-TestStampPattern-729832931 None] Create snapshot completed successfully Jul 15 18:41:01 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[1796bd89-b93d-451f-806d-acc9a04fc16a]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-4b963c2d-8c0e-461e-8a40-93a0f1a6f44a req-a8c25427-a4cf-494e-9e35-7c9956283d6f tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:01 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea Jul 15 18:41:01 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:01 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-4b963c2d-8c0e-461e-8a40-93a0f1a6f44a req-a8c25427-a4cf-494e-9e35-7c9956283d6f tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea" returned: 0 in 0.372s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-4b963c2d-8c0e-461e-8a40-93a0f1a6f44a req-a8c25427-a4cf-494e-9e35-7c9956283d6f tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:01 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea Jul 15 18:41:01 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:02 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-4b963c2d-8c0e-461e-8a40-93a0f1a6f44a req-a8c25427-a4cf-494e-9e35-7c9956283d6f tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea" returned: 1 in 0.422s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-4b963c2d-8c0e-461e-8a40-93a0f1a6f44a req-a8c25427-a4cf-494e-9e35-7c9956283d6f tempest-TestInstancesWithCinderVolumes-1397700888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-4b963c2d-8c0e-461e-8a40-93a0f1a6f44a req-a8c25427-a4cf-494e-9e35-7c9956283d6f tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.838s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.342s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db04f443-ec1b-4349-b750-4d1d3f7d1197,created_at=2026-07-15T16:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1837634079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db04f443-ec1b-4349-b750-4d1d3f7d1197,host='devstack@QuobyteHD#QuobyteHD',id=1302ae1e-ec4b-4303-8682-284a5e55dbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5b53a35b34413a806611d645ae98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:01Z,use_quota=True,user_id='2274d1f2b7774bd89d07a93c7dce102e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11134910-d652-41ea-b508-49adcd2fc725),volume_type_id=11134910-d652-41ea-b508-49adcd2fc725)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Creating volume 1302ae1e-ec4b-4303-8682-284a5e55dbad {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:41:02 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:02 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad 1073741824 Jul 15 18:41:02 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-4b963c2d-8c0e-461e-8a40-93a0f1a6f44a req-a8c25427-a4cf-494e-9e35-7c9956283d6f tempest-TestInstancesWithCinderVolumes-1397700888 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-b66e9977-1149-48df-937e-98b5996382ea', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7eeebacc-c23d-4712-8228-72fb2f01c0cd', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:41:02 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-4b963c2d-8c0e-461e-8a40-93a0f1a6f44a req-a8c25427-a4cf-494e-9e35-7c9956283d6f tempest-TestInstancesWithCinderVolumes-1397700888 None] attachment_update completed successfully. Jul 15 18:41:02 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad 1073741824" returned: 0 in 0.664s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:02 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad Jul 15 18:41:02 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:03 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad" returned: 0 in 0.286s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:41:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c3ebc3-e040-435a-aba6-432945479ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1302ae1e-ec4b-4303-8682-284a5e55dbad', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1563f0d3-2ea6-4f4f-912b-761a9ce5f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:03 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Volume volume-1302ae1e-ec4b-4303-8682-284a5e55dbad (1302ae1e-ec4b-4303-8682-284a5e55dbad): created successfully Jul 15 18:41:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1563f0d3-2ea6-4f4f-912b-761a9ce5f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Flow 'volume_create_manager' (2cb6f39d-1bba-44ea-968c-a7a6ed24faad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7a66e0dd-8d5d-4d99-9820-865f2383a962 tempest-GroupSnapshotsTest-2000156750 None] Created volume successfully. Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Flow 'volume_create_manager' (82101ac6-d9ee-4575-b6a7-8c0ce0a2ec71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2745835e-6d22-4aa7-b361-49b54fd222de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2745835e-6d22-4aa7-b361-49b54fd222de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2082713757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db04f443-ec1b-4349-b750-4d1d3f7d1197,host='devstack@QuobyteHD#QuobyteHD',id=bb74bacd-1a74-433e-8a79-5410c9bf6047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5b53a35b34413a806611d645ae98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:05Z,use_quota=True,user_id='2274d1f2b7774bd89d07a93c7dce102e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11134910-d652-41ea-b508-49adcd2fc725),volume_type_id=11134910-d652-41ea-b508-49adcd2fc725)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1a2358-04f9-4144-acb9-62f0c0ca22cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1a2358-04f9-4144-acb9-62f0c0ca22cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69ff5e5-6313-4508-a998-490f0229590c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69ff5e5-6313-4508-a998-490f0229590c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb74bacd-1a74-433e-8a79-5410c9bf6047', 'volume_name': 'volume-bb74bacd-1a74-433e-8a79-5410c9bf6047', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a181526-0637-4de9-9ee8-26aa7d511983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a181526-0637-4de9-9ee8-26aa7d511983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ffab4c-d078-4e0e-971c-18af6886233a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:05 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Volume bb74bacd-1a74-433e-8a79-5410c9bf6047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb74bacd-1a74-433e-8a79-5410c9bf6047', 'volume_size': 1} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db04f443-ec1b-4349-b750-4d1d3f7d1197,created_at=2026-07-15T16:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2082713757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db04f443-ec1b-4349-b750-4d1d3f7d1197,host='devstack@QuobyteHD#QuobyteHD',id=bb74bacd-1a74-433e-8a79-5410c9bf6047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5b53a35b34413a806611d645ae98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:05Z,use_quota=True,user_id='2274d1f2b7774bd89d07a93c7dce102e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11134910-d652-41ea-b508-49adcd2fc725),volume_type_id=11134910-d652-41ea-b508-49adcd2fc725)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Creating volume bb74bacd-1a74-433e-8a79-5410c9bf6047 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:41:05 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:05 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 1073741824 Jul 15 18:41:05 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:05 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 1073741824" returned: 0 in 0.561s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:05 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 Jul 15 18:41:05 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:06 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047" returned: 0 in 0.339s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:41:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ffab4c-d078-4e0e-971c-18af6886233a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb74bacd-1a74-433e-8a79-5410c9bf6047', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a5899c-60fe-4241-b466-2853bb06dedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:06 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Volume volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 (bb74bacd-1a74-433e-8a79-5410c9bf6047): created successfully Jul 15 18:41:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a5899c-60fe-4241-b466-2853bb06dedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Flow 'volume_create_manager' (82101ac6-d9ee-4575-b6a7-8c0ce0a2ec71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:06 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-caec8f1b-a9ba-4487-a4bc-86d4171f6fdc tempest-GroupSnapshotsTest-2000156750 None] Created volume successfully. Jul 15 18:41:07 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-5ec70045-1a9f-447f-9d43-95182820853b tempest-GroupSnapshotsTest-2000156750 None] Update group completed successfully. Jul 15 18:41:09 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-845bf031-6c8c-46e0-bc76-977c73224057 tempest-GroupSnapshotsTest-2000156750 None] Update group completed successfully. Jul 15 18:41:10 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-39600659-2305-45d2-ad74-393d177ccba9 tempest-GroupSnapshotsTest-2000156750 None] Update group completed successfully. Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Flow 'volume_create_manager' (1a943475-8811-4920-a4c4-408c63ce36a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856eec84-1c03-4cf0-9604-5af2ea1f8fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856eec84-1c03-4cf0-9604-5af2ea1f8fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-113376661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1630630c-1fc3-4cb2-bb05-da3b54c7d08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb814acb961478bbc6ae1e87e04aa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=80d72ef1-3cd0-44f6-862a-da4a38a4ede7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:11Z,use_quota=True,user_id='72ae8c34d2204a58bae985bb0106c42b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3ca505-4411-46f8-9e07-57adac71fbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3ca505-4411-46f8-9e07-57adac71fbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4873c3a2-1155-4896-a0be-1172b8f10378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4873c3a2-1155-4896-a0be-1172b8f10378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1630630c-1fc3-4cb2-bb05-da3b54c7d08e', 'volume_name': 'volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e', 'volume_size': 1, 'snapshot_id': '80d72ef1-3cd0-44f6-862a-da4a38a4ede7'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2151d15-257a-480f-bd39-6e966600078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2151d15-257a-480f-bd39-6e966600078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943e59b5-a94a-47b3-bed9-f473c1bd1f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:11 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Volume 1630630c-1fc3-4cb2-bb05-da3b54c7d08e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e', 'volume_size': 1, 'snapshot_id': '80d72ef1-3cd0-44f6-862a-da4a38a4ede7'} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Acquiring lock "cinder-quobyte-80d72ef1-3cd0-44f6-862a-da4a38a4ede7-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" by "_create_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Lock "cinder-quobyte-80d72ef1-3cd0-44f6-862a-da4a38a4ede7-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Creating volume 1630630c-1fc3-4cb2-bb05-da3b54c7d08e from snapshot 80d72ef1-3cd0-44f6-862a-da4a38a4ede7 {{(pid=87217) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Acquiring lock "cinder-quobyte-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" by "_copy_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Lock "cinder-quobyte-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" acquired by "_copy_volume_from_snapshot" :: waited 0.062s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] snapshot: 80d72ef1-3cd0-44f6-862a-da4a38a4ede7, volume: 1630630c-1fc3-4cb2-bb05-da3b54c7d08e, {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:12 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac55649a-732f-47a4-8dea-130b34fb131f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:12 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-04a9514b-8175-49cd-8a2e-af92ff3a86ee tempest-GroupSnapshotsTest-2000156750 None] Update group completed successfully. Jul 15 18:41:12 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 Jul 15 18:41:12 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:12 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7" returned: 0 in 0.538s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:41:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:41:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Creating direct copy from snapshot {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:41:12 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac8a7c0-4cda-4b82-a8b2-b89840e79b9a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:12 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 Jul 15 18:41:12 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:13 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" returned: 0 in 0.576s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:13 devstack cinder-volume[87217]: DEBUG cinder.utils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Path /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e not found in is_blk_device check {{(pid=87217) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:41:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:13 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e Jul 15 18:41:13 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:14 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] GroupSnapshot bf923213-462f-4fab-aada-6fd2bb2ba0a9: creating. Jul 15 18:41:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Group snapshot bf923213-462f-4fab-aada-6fd2bb2ba0a9: creating. {{(pid=87217) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 15 18:41:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:20 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" returned: 0 in 7.212s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:20 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5db26cc-142d-49fa-a0c6-fb6be9f38206]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:20 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 Jul 15 18:41:20 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:21 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" returned: 0 in 0.758s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7, size 1024.00 MB, duration 7.21 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:41:21 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Converted 1024.00 MB image at 141.97 MB/s Jul 15 18:41:21 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e is being set with open permissions: ugo+rw Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:21 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e Jul 15 18:41:21 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:21 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" returned: 0 in 0.345s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Lock "cinder-quobyte-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" released by "_copy_volume_from_snapshot" :: held 9.638s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Lock "cinder-quobyte-80d72ef1-3cd0-44f6-862a-da4a38a4ede7-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" released by "_create_volume_from_snapshot" :: held 9.735s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.797s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.161s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Creating offline snapshot 665f811d-85a4-4495-be3c-4fb09493a37c of volume 1302ae1e-ec4b-4303-8682-284a5e55dbad {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943e59b5-a94a-47b3-bed9-f473c1bd1f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e', 'volume_size': 1, 'snapshot_id': '80d72ef1-3cd0-44f6-862a-da4a38a4ede7'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4a1fe8-16ca-49c1-8f28-bc1aef166f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1af25f-850b-475e-85d8-20af88e0d331]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:21 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Volume volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e (1630630c-1fc3-4cb2-bb05-da3b54c7d08e): created successfully Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4a1fe8-16ca-49c1-8f28-bc1aef166f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Flow 'volume_create_manager' (1a943475-8811-4920-a4c4-408c63ce36a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:21 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a14c08eb-7924-41de-9b9f-d4d9081c0ae0 tempest-TestStampPattern-729832931 None] Created volume successfully. Jul 15 18:41:21 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad Jul 15 18:41:21 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:22 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad" returned: 0 in 0.647s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:22 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c 1G Jul 15 18:41:22 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:23 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c 1G" returned: 0 in 0.830s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1302ae1e-ec4b-4303-8682-284a5e55dbad -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:23 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1302ae1e-ec4b-4303-8682-284a5e55dbad -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c Jul 15 18:41:23 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:23 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1302ae1e-ec4b-4303-8682-284a5e55dbad -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c" returned: 0 in 0.586s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:23 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:41:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:23 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c Jul 15 18:41:23 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:23 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c" returned: 0 in 0.323s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:24 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.info Jul 15 18:41:24 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:24 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.info" returned: 0 in 0.341s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:24 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.info is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:41:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:24 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.info Jul 15 18:41:24 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:24 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.info" returned: 0 in 0.308s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.181s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Creating offline snapshot d560ba77-6865-4497-af3d-15b0cf1a1945 of volume bb74bacd-1a74-433e-8a79-5410c9bf6047 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:41:24 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac47705-eccc-471b-94ea-d6ce74dab011]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:24 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 Jul 15 18:41:24 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:25 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047" returned: 0 in 0.420s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:25 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 1G Jul 15 18:41:25 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:25 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 1G" returned: 0 in 0.517s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:25 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 Jul 15 18:41:25 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:26 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945" returned: 0 in 0.334s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:26 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:41:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:26 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 Jul 15 18:41:26 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:26 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945" returned: 0 in 0.267s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:26 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.info Jul 15 18:41:26 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:26 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.info" returned: 0 in 0.284s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:26 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.info is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:41:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:26 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.info Jul 15 18:41:26 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:26 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.info" returned: 0 in 0.254s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:26 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=84,cinder:UPDATE=67,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:41:26 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=62,cinder:SELECT=88,cinder:DELETE=4,cinder:INSERT=14 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:41:27 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-35d1cd8b-8bc4-4631-8491-f6b7f928e076 tempest-GroupSnapshotsTest-2000156750 None] group_snapshot bf923213-462f-4fab-aada-6fd2bb2ba0a9: created successfully Jul 15 18:41:27 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] group_snapshot bf923213-462f-4fab-aada-6fd2bb2ba0a9: deleting Jul 15 18:41:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] group_snapshot bf923213-462f-4fab-aada-6fd2bb2ba0a9: deleting {{(pid=87217) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 15 18:41:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-1302ae1e-ec4b-4303-8682-284a5e55dbad" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-1302ae1e-ec4b-4303-8682-284a5e55dbad" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-665f811d-85a4-4495-be3c-4fb09493a37c" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-665f811d-85a4-4495-be3c-4fb09493a37c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Deleting offline snapshot 665f811d-85a4-4495-be3c-4fb09493a37c of volume 1302ae1e-ec4b-4303-8682-284a5e55dbad {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:41:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] snapshot_file for this snap is: volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:41:27 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9d19fa-6b65-4ea1-ae88-8e1f06bb9a4e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:28 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c Jul 15 18:41:28 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:28 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c" returned: 0 in 0.450s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1302ae1e-ec4b-4303-8682-284a5e55dbad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:41:28 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b590d7e8-4fb9-4422-a0f3-ecf6dad43726]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:28 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad Jul 15 18:41:28 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:28 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad" returned: 0 in 0.435s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:28 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c Jul 15 18:41:28 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:29 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c" returned: 0 in 0.382s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:29 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c Jul 15 18:41:29 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:29 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad.665f811d-85a4-4495-be3c-4fb09493a37c" returned: 0 in 0.255s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-665f811d-85a4-4495-be3c-4fb09493a37c" released by "_delete_snapshot" :: held 1.641s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-1302ae1e-ec4b-4303-8682-284a5e55dbad" released by "delete_snapshot" :: held 1.668s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-bb74bacd-1a74-433e-8a79-5410c9bf6047" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-bb74bacd-1a74-433e-8a79-5410c9bf6047" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-d560ba77-6865-4497-af3d-15b0cf1a1945" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-d560ba77-6865-4497-af3d-15b0cf1a1945" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Deleting offline snapshot d560ba77-6865-4497-af3d-15b0cf1a1945 of volume bb74bacd-1a74-433e-8a79-5410c9bf6047 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] snapshot_file for this snap is: volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[617772e7-ead2-417c-ba75-daaaf0e0b617]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:29 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 Jul 15 18:41:29 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:29 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945" returned: 0 in 0.420s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb74bacd-1a74-433e-8a79-5410c9bf6047(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:41:30 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[453c2190-0d7a-48ae-93e0-9b19a27143f1]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:30 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 Jul 15 18:41:30 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:30 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047" returned: 0 in 0.455s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:30 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 Jul 15 18:41:30 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:30 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945" returned: 0 in 0.360s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:30 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945 Jul 15 18:41:30 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:31 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047.d560ba77-6865-4497-af3d-15b0cf1a1945" returned: 0 in 0.271s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-d560ba77-6865-4497-af3d-15b0cf1a1945" released by "_delete_snapshot" :: held 1.650s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-bb74bacd-1a74-433e-8a79-5410c9bf6047" released by "delete_snapshot" :: held 1.686s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:31 devstack cinder-volume[87217]: WARNING cinder.quota [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1196981835 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1196981835, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:41:31 devstack cinder-volume[87217]: WARNING cinder.quota [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1196981835 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1196981835, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:41:31 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['620454d1-8e2c-466d-bdcd-2ef091d8c0c1', '66635d6b-1436-48a2-81a8-62316a250563', 'c9f06d1b-c232-463c-b52d-a48ab8fcc434', 'd0b21dbb-c98d-45ba-afad-2cd6bee4353e'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:31 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['f379fcb7-8889-4ea9-913b-fee6f9110107', '3e7d78ea-86d6-46ff-ac7a-17abc3a74153', '63f8bcab-c8eb-4b86-83d1-4913fca121e6', '9d2a9cce-2c38-44fc-99e7-e17aedb86395'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:31 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-75c49f63-ca0b-422d-b6a9-bfcce6792ae0 tempest-GroupSnapshotsTest-2000156750 None] group_snapshot bf923213-462f-4fab-aada-6fd2bb2ba0a9: deleted successfully Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:32 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:41:32 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-1302ae1e-ec4b-4303-8682-284a5e55dbad" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-1302ae1e-ec4b-4303-8682-284a5e55dbad" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e804df-310b-40bf-bb5f-c56fe87cc352]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:32 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad Jul 15 18:41:32 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:32 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.301s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:41:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:41:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:41:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:41:33 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad" returned: 0 in 0.415s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:33 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad Jul 15 18:41:33 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:33 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1302ae1e-ec4b-4303-8682-284a5e55dbad" returned: 0 in 0.265s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:33 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-1302ae1e-ec4b-4303-8682-284a5e55dbad" released by "delete_volume" :: held 0.756s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:33 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-bb74bacd-1a74-433e-8a79-5410c9bf6047" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:33 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-bb74bacd-1a74-433e-8a79-5410c9bf6047" acquired by "delete_volume" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:33 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[892f7b30-ca83-4a8a-a9c3-0f89c2ce311e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:33 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 Jul 15 18:41:33 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:34 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047" returned: 0 in 0.431s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:34 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047 Jul 15 18:41:34 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:34 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bb74bacd-1a74-433e-8a79-5410c9bf6047" returned: 0 in 0.296s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-bb74bacd-1a74-433e-8a79-5410c9bf6047" released by "delete_volume" :: held 0.787s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['b4889614-0a46-4ed8-936d-bb67305e4b48'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:34 devstack cinder-volume[87217]: WARNING cinder.quota [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1196981835 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1196981835, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['da47ee7f-44a8-4c5a-9d6b-4ad61ba7e32e', 'fae6ccc3-14e3-490c-bb25-a9f66ee5dfd3', '9fc3c64b-9ba9-4487-bf11-4fa5d39d56e7', 'bec0ab5e-5fff-4416-9c0f-b74c82b2437a'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['5db4298b-d34d-44bd-bb77-cc01e127b896', '68fe5360-2ce5-475f-bd0a-7f2fdf74b2f5', 'd7fcd978-6adf-4161-beac-233c1196a195', '416000ef-a4ad-4674-9ee0-83f945996502'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:34 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:41:34 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:35 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.313s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:35 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:41:35 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b8c87b32-a33f-4717-9f04-cfd34c375d78 tempest-GroupSnapshotsTest-2000156750 None] Delete group completed successfully. Jul 15 18:41:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-4a633864-01dc-4188-a710-3ff3cd066bf3 req-81c20919-9ed6-451e-9367-dc335d40a8cf tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-4a633864-01dc-4188-a710-3ff3cd066bf3 req-81c20919-9ed6-451e-9367-dc335d40a8cf tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:35 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3104044d-9b91-48f8-a441-b7bd2c3bfc9b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-4a633864-01dc-4188-a710-3ff3cd066bf3 req-81c20919-9ed6-451e-9367-dc335d40a8cf tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:35 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 Jul 15 18:41:35 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:35 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-4a633864-01dc-4188-a710-3ff3cd066bf3 req-81c20919-9ed6-451e-9367-dc335d40a8cf tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4" returned: 0 in 0.491s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-4a633864-01dc-4188-a710-3ff3cd066bf3 req-81c20919-9ed6-451e-9367-dc335d40a8cf tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.509s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-4a633864-01dc-4188-a710-3ff3cd066bf3 req-81c20919-9ed6-451e-9367-dc335d40a8cf tempest-TestInstancesWithCinderVolumes-1397700888 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5445d426-c842-452c-ad8d-8f3d92ee554f', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:41:35 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-4a633864-01dc-4188-a710-3ff3cd066bf3 req-81c20919-9ed6-451e-9367-dc335d40a8cf tempest-TestInstancesWithCinderVolumes-1397700888 None] attachment_update completed successfully. Jul 15 18:41:35 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a28e8fdb-140e-45af-bc34-16047f5e6d17 tempest-GroupSnapshotsTest-2000156750 None] Group tempest-GroupSnapshotsTest-Group-73839569: creating Jul 15 18:41:36 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a28e8fdb-140e-45af-bc34-16047f5e6d17 tempest-GroupSnapshotsTest-2000156750 None] Group tempest-GroupSnapshotsTest-Group-73839569: created successfully Jul 15 18:41:36 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a28e8fdb-140e-45af-bc34-16047f5e6d17 tempest-GroupSnapshotsTest-2000156750 None] Create group completed successfully. Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Flow 'volume_create_manager' (cba3bced-ad33-4206-8d15-78a51649a61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eadd22c-03b3-428d-b539-a17659376f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eadd22c-03b3-428d-b539-a17659376f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1801500359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=848c2ffe-a256-49fc-ba5d-ff339dfae7ee,host='devstack@QuobyteHD#QuobyteHD',id=7115930e-df66-4eec-9e77-308db37e78d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5b53a35b34413a806611d645ae98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:38Z,use_quota=True,user_id='2274d1f2b7774bd89d07a93c7dce102e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae227e80-6c17-45d8-bc8d-c2d8fe087c8f),volume_type_id=ae227e80-6c17-45d8-bc8d-c2d8fe087c8f)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af81c0b-ff9a-468c-8bc7-b94dd5a17dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af81c0b-ff9a-468c-8bc7-b94dd5a17dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3553a7-cdb8-4672-a36f-07dd32f0f600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3553a7-cdb8-4672-a36f-07dd32f0f600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7115930e-df66-4eec-9e77-308db37e78d2', 'volume_name': 'volume-7115930e-df66-4eec-9e77-308db37e78d2', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65972117-7062-4349-a674-97adf6cba4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65972117-7062-4349-a674-97adf6cba4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0591eb-829d-484a-9d44-00b46395babb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:37 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Volume 7115930e-df66-4eec-9e77-308db37e78d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7115930e-df66-4eec-9e77-308db37e78d2', 'volume_size': 1} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=848c2ffe-a256-49fc-ba5d-ff339dfae7ee,created_at=2026-07-15T16:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1801500359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=848c2ffe-a256-49fc-ba5d-ff339dfae7ee,host='devstack@QuobyteHD#QuobyteHD',id=7115930e-df66-4eec-9e77-308db37e78d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e5b53a35b34413a806611d645ae98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:41:38Z,use_quota=True,user_id='2274d1f2b7774bd89d07a93c7dce102e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae227e80-6c17-45d8-bc8d-c2d8fe087c8f),volume_type_id=ae227e80-6c17-45d8-bc8d-c2d8fe087c8f)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Creating volume 7115930e-df66-4eec-9e77-308db37e78d2 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:41:37 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:41:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:37 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 1073741824 Jul 15 18:41:37 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:38 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 1073741824" returned: 0 in 0.501s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:38 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 Jul 15 18:41:38 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-95d2edc0-2951-47a1-8db8-f9054156145e req-b8f9fd95-4bd6-46dd-8e29-af24e9a575ae tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:38 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2" returned: 0 in 0.250s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-95d2edc0-2951-47a1-8db8-f9054156145e req-b8f9fd95-4bd6-46dd-8e29-af24e9a575ae tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.153s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0591eb-829d-484a-9d44-00b46395babb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7115930e-df66-4eec-9e77-308db37e78d2', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172e5fa8-9eae-4379-919b-f7c6cf8a3474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a81382-9880-462d-84d7-0808179335c1]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-95d2edc0-2951-47a1-8db8-f9054156145e req-b8f9fd95-4bd6-46dd-8e29-af24e9a575ae tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:38 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Volume volume-7115930e-df66-4eec-9e77-308db37e78d2 (7115930e-df66-4eec-9e77-308db37e78d2): created successfully Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172e5fa8-9eae-4379-919b-f7c6cf8a3474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Flow 'volume_create_manager' (cba3bced-ad33-4206-8d15-78a51649a61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:41:38 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-19bef3dc-8656-41a4-9a5a-8b3e1b29e697 tempest-GroupSnapshotsTest-2000156750 None] Created volume successfully. Jul 15 18:41:38 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119 Jul 15 18:41:38 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:38 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-95d2edc0-2951-47a1-8db8-f9054156145e req-b8f9fd95-4bd6-46dd-8e29-af24e9a575ae tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119" returned: 0 in 0.387s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-95d2edc0-2951-47a1-8db8-f9054156145e req-b8f9fd95-4bd6-46dd-8e29-af24e9a575ae tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.411s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:38 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-95d2edc0-2951-47a1-8db8-f9054156145e req-b8f9fd95-4bd6-46dd-8e29-af24e9a575ae tempest-TestInstancesWithCinderVolumes-1397700888 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-114550e5-c405-49f5-ac13-cf9d07999119', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b134fd63-efeb-40a8-9566-87e39f3ee20d', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:41:39 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-95d2edc0-2951-47a1-8db8-f9054156145e req-b8f9fd95-4bd6-46dd-8e29-af24e9a575ae tempest-TestInstancesWithCinderVolumes-1397700888 None] attachment_update completed successfully. Jul 15 18:41:39 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] GroupSnapshot 2a1ec5df-5bf7-4202-aa4d-5024431220da: creating. Jul 15 18:41:39 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] Group snapshot 2a1ec5df-5bf7-4202-aa4d-5024431220da: creating. {{(pid=87217) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 15 18:41:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] Creating offline snapshot 857b3e0b-4621-4708-aedf-239f57c4764b of volume 7115930e-df66-4eec-9e77-308db37e78d2 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:41:39 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ec90ed-e09a-46f6-bedb-c629a039d7cf]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:39 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 Jul 15 18:41:39 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:39 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2" returned: 0 in 0.406s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:39 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b 1G Jul 15 18:41:39 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:39 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b 1G" returned: 0 in 0.392s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7115930e-df66-4eec-9e77-308db37e78d2 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:40 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7115930e-df66-4eec-9e77-308db37e78d2 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b Jul 15 18:41:40 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:40 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7115930e-df66-4eec-9e77-308db37e78d2 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b" returned: 0 in 0.300s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:40 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:41:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:40 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b Jul 15 18:41:40 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:40 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b" returned: 0 in 0.255s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:40 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.info Jul 15 18:41:40 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:40 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.info" returned: 0 in 0.272s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:40 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 15 18:41:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:40 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.info Jul 15 18:41:40 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:41 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.info" returned: 0 in 0.266s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:41 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d2ac951d-8039-4a3b-9d55-3968ff26d873 tempest-GroupSnapshotsTest-2000156750 None] group_snapshot 2a1ec5df-5bf7-4202-aa4d-5024431220da: created successfully Jul 15 18:41:41 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] group_snapshot 2a1ec5df-5bf7-4202-aa4d-5024431220da: deleting Jul 15 18:41:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] group_snapshot 2a1ec5df-5bf7-4202-aa4d-5024431220da: deleting {{(pid=87217) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 15 18:41:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-7115930e-df66-4eec-9e77-308db37e78d2" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-7115930e-df66-4eec-9e77-308db37e78d2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-857b3e0b-4621-4708-aedf-239f57c4764b" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-857b3e0b-4621-4708-aedf-239f57c4764b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Deleting offline snapshot 857b3e0b-4621-4708-aedf-239f57c4764b of volume 7115930e-df66-4eec-9e77-308db37e78d2 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:41:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] snapshot_file for this snap is: volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:41:41 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc08129-fd2e-440f-9487-a1bdf8e01868]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:41 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b Jul 15 18:41:41 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:42 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b" returned: 0 in 0.416s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7115930e-df66-4eec-9e77-308db37e78d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:41:42 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b0ddc2-d055-49c9-a14a-5175fa883c4d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:42 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 Jul 15 18:41:42 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:42 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2" returned: 0 in 0.386s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:42 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b Jul 15 18:41:42 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:42 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b" returned: 0 in 0.361s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:42 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b Jul 15 18:41:42 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:43 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2.857b3e0b-4621-4708-aedf-239f57c4764b" returned: 0 in 0.248s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-857b3e0b-4621-4708-aedf-239f57c4764b" released by "_delete_snapshot" :: held 1.520s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-7115930e-df66-4eec-9e77-308db37e78d2" released by "delete_snapshot" :: held 1.552s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:43 devstack cinder-volume[87217]: WARNING cinder.quota [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1009085940 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1009085940, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:41:43 devstack cinder-volume[87217]: WARNING cinder.quota [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1009085940 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1009085940, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:41:43 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['246bb4fe-b62e-4347-ae49-f4542df0ab05', '24ab0b29-36b9-4247-8c03-9a2eaab4ef3f', 'cfc63eb3-0b17-4c81-b96e-31466bcefa28', 'c55265ff-45b0-4f4e-b245-0ca53c3a7334'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:43 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c6c3e45b-7d31-4e4d-bbf6-1b5fac74af4c tempest-GroupSnapshotsTest-2000156750 None] group_snapshot 2a1ec5df-5bf7-4202-aa4d-5024431220da: deleted successfully Jul 15 18:41:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "cinder-quobyte-7115930e-df66-4eec-9e77-308db37e78d2" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-7115930e-df66-4eec-9e77-308db37e78d2" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:44 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[975ecabb-37ad-4730-ae85-f66c0768ff6f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:44 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 Jul 15 18:41:44 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:44 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-6546b8e8-56da-440b-a54d-fa5df64e6bfa req-b488b18d-7836-484b-96b8-5c8c038571f5 tempest-TestInstancesWithCinderVolumes-1397700888 None] Terminate volume connection completed successfully. Jul 15 18:41:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-6546b8e8-56da-440b-a54d-fa5df64e6bfa req-b488b18d-7836-484b-96b8-5c8c038571f5 tempest-TestInstancesWithCinderVolumes-1397700888 None] Deleting attachment 5445d426-c842-452c-ad8d-8f3d92ee554f. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:41:44 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2" returned: 0 in 0.407s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:44 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2 Jul 15 18:41:44 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:44 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7115930e-df66-4eec-9e77-308db37e78d2" returned: 0 in 0.252s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Lock "cinder-quobyte-7115930e-df66-4eec-9e77-308db37e78d2" released by "delete_volume" :: held 0.722s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:44 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['6cc91adb-1788-43f5-8ebc-c03e8584bc66'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:44 devstack cinder-volume[87217]: WARNING cinder.quota [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1009085940 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1009085940, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Created reservations ['864741e6-2ba4-4ab5-9ead-a4a4203f0bd0', 'f4d6ff72-41f0-4b70-a77a-41bbe5a5a46c', 'e3c07186-eb99-4a45-962e-d8ffab92facb', '7891082d-2608-4c19-9e3f-fa033c3a0970'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:45 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:41:45 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "cinder-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "cinder-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "cinder-quobyte-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "cinder-quobyte-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e2e968-efa5-498e-b435-812ed3384672]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:45 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 Jul 15 18:41:45 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:45 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.266s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:41:45 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ad7af4ff-8c8f-423f-ae9a-064fca7ab8e1 tempest-GroupSnapshotsTest-2000156750 None] Delete group completed successfully. Jul 15 18:41:45 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4" returned: 0 in 0.406s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:45 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4 Jul 15 18:41:45 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:45 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4" returned: 0 in 0.300s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "cinder-quobyte-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4" released by "delete_volume" :: held 0.747s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:45 devstack cinder-volume[87217]: WARNING cinder.quota [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-995952192-1963422148 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-995952192-1963422148, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:41:45 devstack cinder-volume[87217]: WARNING cinder.quota [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-995952192-1963422148 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-995952192-1963422148, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:41:46 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Created reservations ['f3cc8251-3263-4ef4-9aa5-a6d7affece4f', '08f1d6d6-1336-4bd4-88b3-19272f402f1b', '747420ff-5660-4e35-bf3e-b647ae43ce77', '37bc93ba-3fd6-4a6e-912d-21810ad3ebe6'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:46 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:41:46 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:46 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.289s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:46 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:41:46 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Deleted volume successfully. Jul 15 18:41:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d41c013e-6c16-4f30-b3cb-fb5c10b4c93f tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "cinder-d9c0f53a-5a25-4f74-a7dd-058c09fc4ef4-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:49 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-7da42961-acd7-4933-803e-6a20ff20ad1c req-6103144e-afda-4ae7-854a-b5d788eab5df tempest-TestInstancesWithCinderVolumes-1397700888 None] Terminate volume connection completed successfully. Jul 15 18:41:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-7da42961-acd7-4933-803e-6a20ff20ad1c req-6103144e-afda-4ae7-854a-b5d788eab5df tempest-TestInstancesWithCinderVolumes-1397700888 None] Deleting attachment b134fd63-efeb-40a8-9566-87e39f3ee20d. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:41:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "cinder-114550e5-c405-49f5-ac13-cf9d07999119-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "cinder-114550e5-c405-49f5-ac13-cf9d07999119-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "cinder-quobyte-114550e5-c405-49f5-ac13-cf9d07999119" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "cinder-quobyte-114550e5-c405-49f5-ac13-cf9d07999119" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:50 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e228d2-f9a9-4345-acb9-a8b6102d722e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:50 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119 Jul 15 18:41:50 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:50 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119" returned: 0 in 0.504s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:50 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119 Jul 15 18:41:50 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:50 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-114550e5-c405-49f5-ac13-cf9d07999119" returned: 0 in 0.384s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "cinder-quobyte-114550e5-c405-49f5-ac13-cf9d07999119" released by "delete_volume" :: held 0.944s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:51 devstack cinder-volume[87217]: WARNING cinder.quota [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1177325834-1404713800 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1177325834-1404713800, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:41:51 devstack cinder-volume[87217]: WARNING cinder.quota [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1177325834-1404713800 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1177325834-1404713800, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Created reservations ['24a8889b-5895-43cf-9521-ae54891c4c39', '34729a94-28db-4223-a2d5-d2e99b180690', '76dc98f9-4e87-4432-8d82-139f6f43ad82', '0881fc5e-5b5d-4d89-98dd-dbbfec6c863a'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:51 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:41:51 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:51 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.400s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:41:51 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Deleted volume successfully. Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-af9af8c3-faaa-4a76-b668-a14383afa316 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "cinder-114550e5-c405-49f5-ac13-cf9d07999119-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-118e44f3-1bf9-479d-96fc-83fe67a68711 req-042658fb-42c6-4e65-8120-cc19d5247e72 tempest-TestStampPattern-729832931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-118e44f3-1bf9-479d-96fc-83fe67a68711 req-042658fb-42c6-4e65-8120-cc19d5247e72 tempest-TestStampPattern-729832931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8420a1-d581-4366-81c4-4c1ff9f0bc62]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-118e44f3-1bf9-479d-96fc-83fe67a68711 req-042658fb-42c6-4e65-8120-cc19d5247e72 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:51 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e Jul 15 18:41:51 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:52 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-118e44f3-1bf9-479d-96fc-83fe67a68711 req-042658fb-42c6-4e65-8120-cc19d5247e72 tempest-TestStampPattern-729832931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" returned: 0 in 0.531s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-118e44f3-1bf9-479d-96fc-83fe67a68711 req-042658fb-42c6-4e65-8120-cc19d5247e72 tempest-TestStampPattern-729832931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.566s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-118e44f3-1bf9-479d-96fc-83fe67a68711 req-042658fb-42c6-4e65-8120-cc19d5247e72 tempest-TestStampPattern-729832931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ba0ed9c-3562-40da-a8a6-33c52be60910', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:41:52 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-118e44f3-1bf9-479d-96fc-83fe67a68711 req-042658fb-42c6-4e65-8120-cc19d5247e72 tempest-TestStampPattern-729832931 None] attachment_update completed successfully. Jul 15 18:41:55 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-033d1b40-cfe3-4b6f-9116-593931b41728 req-c207ac0f-4290-4161-a1a6-5fee7ceba36e tempest-TestStampPattern-729832931 None] Terminate volume connection completed successfully. Jul 15 18:41:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-033d1b40-cfe3-4b6f-9116-593931b41728 req-c207ac0f-4290-4161-a1a6-5fee7ceba36e tempest-TestStampPattern-729832931 None] Deleting attachment 2ba0ed9c-3562-40da-a8a6-33c52be60910. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:41:55 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-54e2b41a-e345-43e5-9083-65e35381588f req-5f69c1cb-d18f-4c80-852e-2291c23bf3fc tempest-TestInstancesWithCinderVolumes-1397700888 None] Terminate volume connection completed successfully. Jul 15 18:41:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-54e2b41a-e345-43e5-9083-65e35381588f req-5f69c1cb-d18f-4c80-852e-2291c23bf3fc tempest-TestInstancesWithCinderVolumes-1397700888 None] Deleting attachment 7eeebacc-c23d-4712-8228-72fb2f01c0cd. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:41:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "cinder-b66e9977-1149-48df-937e-98b5996382ea-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "cinder-b66e9977-1149-48df-937e-98b5996382ea-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "cinder-quobyte-b66e9977-1149-48df-937e-98b5996382ea" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:41:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "cinder-quobyte-b66e9977-1149-48df-937e-98b5996382ea" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:41:56 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[7561b6b2-1056-48d3-8ac6-f8a44f418a32]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:41:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:56 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea Jul 15 18:41:56 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:57 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea" returned: 0 in 0.554s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:57 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea Jul 15 18:41:57 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:57 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea" returned: 1 in 0.537s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:41:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:57 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea Jul 15 18:41:57 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:58 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b66e9977-1149-48df-937e-98b5996382ea" returned: 0 in 0.413s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "cinder-quobyte-b66e9977-1149-48df-937e-98b5996382ea" released by "delete_volume" :: held 1.613s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:41:58 devstack cinder-volume[87217]: WARNING cinder.quota [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-726973820-274616425 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-726973820-274616425, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:41:58 devstack cinder-volume[87217]: WARNING cinder.quota [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-726973820-274616425 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-726973820-274616425, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:41:58 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Created reservations ['73abd90c-a859-4015-94bb-2a06bf50ee2d', '27863f46-a18e-4257-ba4c-51f94ce04ee9', '6c81261b-2794-416a-a744-cb2692986b42', '7300d3f5-2f87-45dd-aa6c-87221adaf049'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:41:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:41:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:41:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:41:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:41:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:41:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:41:58 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:41:58 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:41:58 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 15 18:41:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.304s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:41:58 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:41:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Deleted volume successfully. Jul 15 18:41:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b7058f66-f6dc-4bf2-8781-95e8cad85954 tempest-TestInstancesWithCinderVolumes-1397700888 None] Lock "cinder-b66e9977-1149-48df-937e-98b5996382ea-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Acquiring lock "cinder-1630630c-1fc3-4cb2-bb05-da3b54c7d08e-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Lock "cinder-1630630c-1fc3-4cb2-bb05-da3b54c7d08e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Acquiring lock "cinder-quobyte-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Lock "cinder-quobyte-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:00 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[77636c2e-3bff-4532-8c61-330a31236b4d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:00 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e Jul 15 18:42:00 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:00 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" returned: 0 in 0.445s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:00 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e Jul 15 18:42:00 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:00 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" returned: 0 in 0.283s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Lock "cinder-quobyte-1630630c-1fc3-4cb2-bb05-da3b54c7d08e" released by "delete_volume" :: held 0.773s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Created reservations ['0668aa36-72d5-469d-976c-05ec2a5fa234', 'f06b0866-4161-4564-a9f7-2556276409aa', '8d450e1b-4f3d-4163-a58c-f38f68ef74af', 'a470c3d6-8be1-4779-8417-24e8678cfb68'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:01 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:42:01 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:01 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.309s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:01 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Deleted volume successfully. Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa1388b-ce85-4abd-a1aa-12100b059477 tempest-TestStampPattern-729832931 None] Lock "cinder-1630630c-1fc3-4cb2-bb05-da3b54c7d08e-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Acquiring lock "cinder-80d72ef1-3cd0-44f6-862a-da4a38a4ede7-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Lock "cinder-80d72ef1-3cd0-44f6-862a-da4a38a4ede7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Acquiring lock "cinder-quobyte-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Lock "cinder-quobyte-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Acquiring lock "cinder-quobyte-80d72ef1-3cd0-44f6-862a-da4a38a4ede7" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Lock "cinder-quobyte-80d72ef1-3cd0-44f6-862a-da4a38a4ede7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Deleting offline snapshot 80d72ef1-3cd0-44f6-862a-da4a38a4ede7 of volume 2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] snapshot_file for this snap is: volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a84a7e-8388-47d9-834a-7fd04c4bca4f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:01 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 Jul 15 18:42:01 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:02 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7" returned: 0 in 0.401s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:42:02 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ec5100-7120-4cc0-967a-f5566c2ddf41]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:02 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 Jul 15 18:42:02 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:02 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" returned: 0 in 0.429s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:02 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 Jul 15 18:42:02 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:03 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7" returned: 0 in 0.496s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:03 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7 Jul 15 18:42:03 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:03 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7.80d72ef1-3cd0-44f6-862a-da4a38a4ede7" returned: 0 in 0.309s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Lock "cinder-quobyte-80d72ef1-3cd0-44f6-862a-da4a38a4ede7" released by "_delete_snapshot" :: held 1.768s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Lock "cinder-quobyte-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" released by "delete_snapshot" :: held 1.805s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:03 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Created reservations ['a9f938c8-040a-4cbd-a689-a0302d73afbd', '901d3c62-aeae-4e43-a0de-b21430d24fd1', '0550634f-09d3-4033-8751-4a8b187676fa', '40b5dbfc-18a9-4758-a5ea-414e6b213635'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Delete snapshot completed successfully. Jul 15 18:42:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0a0f5e97-c8e0-40c0-bf00-49fa38c30a39 tempest-TestStampPattern-729832931 None] Lock "cinder-80d72ef1-3cd0-44f6-862a-da4a38a4ede7-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Acquiring lock "cinder-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Lock "cinder-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Acquiring lock "cinder-quobyte-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Lock "cinder-quobyte-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" acquired by "delete_volume" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:09 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6b1944-653c-4aa7-9aea-3a80ee372c2f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:09 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 Jul 15 18:42:09 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:09 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" returned: 0 in 0.418s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:09 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7 Jul 15 18:42:09 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:09 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" returned: 0 in 0.300s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Lock "cinder-quobyte-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7" released by "delete_volume" :: held 0.797s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:10 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Created reservations ['f3d109c8-64b0-4ccf-92f5-084e86c01f6c', 'ae5470f2-cfa2-4c75-9da9-96211e903f78', '95c8f683-0bbf-4acd-b39a-5b4d508e88e8', '793aa566-bf97-45ca-b3ed-d937d467a187'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:10 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:42:10 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:10 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.327s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:10 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:10 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Deleted volume successfully. Jul 15 18:42:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-19e18af3-c5d6-4425-b2f9-017f1d4a809e tempest-TestStampPattern-729832931 None] Lock "cinder-2ff6634c-2f9a-498c-ba7e-b85e6d4354f7-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Flow 'volume_create_manager' (5d459573-6970-49c7-a67a-55223081e6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8091ec-5cdd-46d4-ab60-8bb23e220400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8091ec-5cdd-46d4-ab60-8bb23e220400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-622265981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9014e2-bc24-4e34-b223-07fcc3b5b9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b6a41137d84494baa28e5b7a34b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:11Z,use_quota=True,user_id='a2d7f02cc65041dcb4b071a6ecc73925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7139f17-c058-4089-968a-65a5e28a6386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7139f17-c058-4089-968a-65a5e28a6386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718a5d32-d352-4309-b521-32f26b785deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718a5d32-d352-4309-b521-32f26b785deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9014e2-bc24-4e34-b223-07fcc3b5b9b1', 'volume_name': 'volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed90f6fc-26b9-4599-b01a-f813ba28c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed90f6fc-26b9-4599-b01a-f813ba28c198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20333068-e4d6-42d9-965b-48e24366ff3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:11 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Volume df9014e2-bc24-4e34-b223-07fcc3b5b9b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1', 'volume_size': 1} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-622265981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9014e2-bc24-4e34-b223-07fcc3b5b9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b6a41137d84494baa28e5b7a34b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:11Z,use_quota=True,user_id='a2d7f02cc65041dcb4b071a6ecc73925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Creating volume df9014e2-bc24-4e34-b223-07fcc3b5b9b1 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:11 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:42:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:11 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1 1073741824 Jul 15 18:42:11 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:12 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1 1073741824" returned: 0 in 0.525s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:12 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1 Jul 15 18:42:12 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:12 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1" returned: 0 in 0.304s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20333068-e4d6-42d9-965b-48e24366ff3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd73ae1a-7ede-4495-93de-a2893c6bc535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:12 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Volume volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1 (df9014e2-bc24-4e34-b223-07fcc3b5b9b1): created successfully Jul 15 18:42:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd73ae1a-7ede-4495-93de-a2893c6bc535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Flow 'volume_create_manager' (5d459573-6970-49c7-a67a-55223081e6fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:12 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b422e8c6-1a4a-4d84-9c79-8273db1c13cf tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Created volume successfully. Jul 15 18:42:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Acquiring lock "cinder-df9014e2-bc24-4e34-b223-07fcc3b5b9b1-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Lock "cinder-df9014e2-bc24-4e34-b223-07fcc3b5b9b1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Acquiring lock "cinder-quobyte-df9014e2-bc24-4e34-b223-07fcc3b5b9b1" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Lock "cinder-quobyte-df9014e2-bc24-4e34-b223-07fcc3b5b9b1" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:14 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25b2c1c-a7bc-454c-8879-156f126d1290]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:15 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1 Jul 15 18:42:15 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:15 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1" returned: 0 in 0.421s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:15 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1 Jul 15 18:42:15 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:15 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-df9014e2-bc24-4e34-b223-07fcc3b5b9b1" returned: 0 in 0.268s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Lock "cinder-quobyte-df9014e2-bc24-4e34-b223-07fcc3b5b9b1" released by "delete_volume" :: held 0.741s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:15 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Created reservations ['93016172-9b10-4884-b554-f3a43e24564d', 'd59c8cde-dfbc-43c7-989c-79cbc26819f7', '4b161630-7764-4977-b76b-92d8202f4b26', '68399df4-b4d3-4068-840f-f74d3ef2a304'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:15 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:42:15 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:16 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.368s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:16 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:16 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Deleted volume successfully. Jul 15 18:42:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b48dbd8c-83bf-4646-b1fc-5bcfcad3837e tempest-VolumeQuotasNegativeTestJSON-2016931648 None] Lock "cinder-df9014e2-bc24-4e34-b223-07fcc3b5b9b1-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Flow 'volume_create_manager' (63377d97-759c-428f-8aef-0cf7a38ea462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e5d361-e2ac-472c-8216-7e98022b5e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e5d361-e2ac-472c-8216-7e98022b5e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1556172838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9c86e0-5a76-474d-afe7-2ff272daea06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f3fe39bf15497c8a5b8fbc3aed96bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:25Z,use_quota=True,user_id='086795c2797f4016afcff7555e9eefdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fccb290-11f4-40c0-93b3-d50276ea8304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fccb290-11f4-40c0-93b3-d50276ea8304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb95cfed-3e9f-4d8f-8b6c-b11b8e6bbe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb95cfed-3e9f-4d8f-8b6c-b11b8e6bbe2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9c86e0-5a76-474d-afe7-2ff272daea06', 'volume_name': 'volume-7b9c86e0-5a76-474d-afe7-2ff272daea06', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119ca37a-d27a-4520-a2ac-0a981949ee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119ca37a-d27a-4520-a2ac-0a981949ee10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77f901e-f086-42aa-84ad-fbb0b78621e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:24 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume 7b9c86e0-5a76-474d-afe7-2ff272daea06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9c86e0-5a76-474d-afe7-2ff272daea06', 'volume_size': 1} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1556172838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9c86e0-5a76-474d-afe7-2ff272daea06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f3fe39bf15497c8a5b8fbc3aed96bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:25Z,use_quota=True,user_id='086795c2797f4016afcff7555e9eefdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Creating volume 7b9c86e0-5a76-474d-afe7-2ff272daea06 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:24 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:42:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:24 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 1073741824 Jul 15 18:42:24 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:25 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 1073741824" returned: 0 in 0.502s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:25 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 Jul 15 18:42:25 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:25 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06" returned: 0 in 0.294s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:25 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77f901e-f086-42aa-84ad-fbb0b78621e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9c86e0-5a76-474d-afe7-2ff272daea06', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:25 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829d6ca6-6a8f-46bd-8f0e-8fcbc0e5ed1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:25 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 (7b9c86e0-5a76-474d-afe7-2ff272daea06): created successfully Jul 15 18:42:25 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829d6ca6-6a8f-46bd-8f0e-8fcbc0e5ed1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:25 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Flow 'volume_create_manager' (63377d97-759c-428f-8aef-0cf7a38ea462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:25 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-04c8171c-e067-49bb-8c64-5477ac39ade2 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created volume successfully. Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Flow 'volume_create_manager' (fd1baa58-fa03-4fac-abb1-ee5152f9a5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebe06ea-f038-4b9b-b789-242d28d9920f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebe06ea-f038-4b9b-b789-242d28d9920f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-630817759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e0cf9d-374c-4852-9092-21172d6efb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61022511c6f84fb7a73d41ef9eef3110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:26Z,use_quota=True,user_id='edf5830448484888811082baf3c3b4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefbd69d-c603-4e7f-a942-5b45ca25aea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefbd69d-c603-4e7f-a942-5b45ca25aea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e23d009-d801-490c-a0de-72aa40f34cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG cinder.image.glance [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Creating Keystone auth plugin from conf {{(pid=87217) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Creating offline snapshot e28852de-ae5c-4775-b4ed-5dcc2411edbe of volume 7b9c86e0-5a76-474d-afe7-2ff272daea06 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1062af-d5be-41f2-abfd-a8c706866907]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e23d009-d801-490c-a0de-72aa40f34cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50e0cf9d-374c-4852-9092-21172d6efb86', 'volume_name': 'volume-50e0cf9d-374c-4852-9092-21172d6efb86', 'volume_size': 1, 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1cc7d7f865b4961944a3804db21f9fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'created_at': datetime.datetime(2026, 7, 15, 16, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58cd658a-6d16-40ff-85de-7b9a03ec1256/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d3ef6d-152b-4cf0-a95b-a5ce15169ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d3ef6d-152b-4cf0-a95b-a5ce15169ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd42bba9-6b8c-4df7-bdd4-967d2de7335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:27 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Volume 50e0cf9d-374c-4852-9092-21172d6efb86: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50e0cf9d-374c-4852-9092-21172d6efb86', 'volume_size': 1, 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1cc7d7f865b4961944a3804db21f9fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'created_at': datetime.datetime(2026, 7, 15, 16, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58cd658a-6d16-40ff-85de-7b9a03ec1256/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Trying to clone 50e0cf9d-374c-4852-9092-21172d6efb86 from image 58cd658a-6d16-40ff-85de-7b9a03ec1256 at location (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]). {{(pid=87217) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:42:27 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 Jul 15 18:42:27 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:27 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06" returned: 0 in 0.456s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:27 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe 1G Jul 15 18:42:27 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:42:27 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Image download 20.69 MB at 20.69 MB/s Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c070cc-ab53-4baa-9d29-5cc70a5db7ea]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:27 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD Jul 15 18:42:27 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:27 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe 1G" returned: 0 in 0.502s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:27 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe Jul 15 18:42:27 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:27 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:27 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Temporary image 58cd658a-6d16-40ff-85de-7b9a03ec1256 is fetched for user edf5830448484888811082baf3c3b4fc. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:42:28 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=120,cinder:UPDATE=120,cinder:INSERT=31,cinder:DELETE=4 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:42:28 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=111,cinder:UPDATE=122,cinder:INSERT=27,cinder:DELETE=5 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:42:28 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68915a2-4e91-45b1-8f89-0be351ed3a98]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:28 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD Jul 15 18:42:28 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:28 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe" returned: 0 in 0.316s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:28 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe is being set with open permissions: ugo+rw Jul 15 18:42:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:28 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe Jul 15 18:42:28 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:28 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:28 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe" returned: 0 in 0.273s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:28 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.info Jul 15 18:42:28 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:28 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.info" returned: 0 in 0.246s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:28 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.info is being set with open permissions: ugo+rw Jul 15 18:42:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:28 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.info Jul 15 18:42:28 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:29 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.info" returned: 0 in 0.252s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.639s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-630817759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e0cf9d-374c-4852-9092-21172d6efb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61022511c6f84fb7a73d41ef9eef3110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:26Z,use_quota=True,user_id='edf5830448484888811082baf3c3b4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Creating volume 50e0cf9d-374c-4852-9092-21172d6efb86 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:29 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:29 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 1073741824 Jul 15 18:42:29 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:29 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-5781b718-d6f8-4a77-b165-4b88012ebaf4 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Create snapshot completed successfully Jul 15 18:42:29 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 1073741824" returned: 0 in 0.508s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:29 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 Jul 15 18:42:29 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:29 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86" returned: 0 in 0.256s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:29 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Attempting download of 58cd658a-6d16-40ff-85de-7b9a03ec1256 ((None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}])) to volume 50e0cf9d-374c-4852-9092-21172d6efb86. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70823a6-abd3-44a7-addd-3e4ac22f3f16]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_4yk8dtbm {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:30 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_4yk8dtbm Jul 15 18:42:30 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:30 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_4yk8dtbm" returned: 0 in 0.373s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_4yk8dtbm {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:30 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_4yk8dtbm Jul 15 18:42:30 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Flow 'volume_create_manager' (f85ee67b-248b-4393-87d5-fb4236da635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27833ff-11b8-4871-8c59-db208a7caacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27833ff-11b8-4871-8c59-db208a7caacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147688963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88492238-0718-412d-90c2-ef165d37a9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f3fe39bf15497c8a5b8fbc3aed96bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:31Z,use_quota=True,user_id='086795c2797f4016afcff7555e9eefdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179fb936-b6b9-424b-bc09-2268576d5280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179fb936-b6b9-424b-bc09-2268576d5280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbb1ab8-216b-4708-9662-863dfecfe044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbb1ab8-216b-4708-9662-863dfecfe044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88492238-0718-412d-90c2-ef165d37a9c8', 'volume_name': 'volume-88492238-0718-412d-90c2-ef165d37a9c8', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79ce115-81a6-4a4c-b419-284e1cfbd6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79ce115-81a6-4a4c-b419-284e1cfbd6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1db99d-cc6a-4272-883d-bdedb02926f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:30 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume 88492238-0718-412d-90c2-ef165d37a9c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88492238-0718-412d-90c2-ef165d37a9c8', 'volume_size': 1} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147688963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88492238-0718-412d-90c2-ef165d37a9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f3fe39bf15497c8a5b8fbc3aed96bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:31Z,use_quota=True,user_id='086795c2797f4016afcff7555e9eefdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Creating volume 88492238-0718-412d-90c2-ef165d37a9c8 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:30 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:42:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-88492238-0718-412d-90c2-ef165d37a9c8 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:30 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-88492238-0718-412d-90c2-ef165d37a9c8 1073741824 Jul 15 18:42:30 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:31 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_4yk8dtbm" returned: 1 in 0.619s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_4yk8dtbm' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e8237d-bc9a-4cf7-ac24-4292f2ea84e8]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:31 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD Jul 15 18:42:31 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:31 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Flow 'volume_create_manager' (b414016f-e722-4a62-9818-50e08421d4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167767d4-3be0-41ea-aecd-dcc711a46308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-88492238-0718-412d-90c2-ef165d37a9c8 1073741824" returned: 0 in 0.748s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167767d4-3be0-41ea-aecd-dcc711a46308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1271868006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a13d6b-fb65-48ce-a0c2-8c5377fba044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f3fe39bf15497c8a5b8fbc3aed96bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:31Z,use_quota=True,user_id='086795c2797f4016afcff7555e9eefdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850642a9-6fac-45ee-98e1-fdd3c34b6e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:31 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850642a9-6fac-45ee-98e1-fdd3c34b6e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27f0f61-80ba-4423-8320-1b14e930844e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27f0f61-80ba-4423-8320-1b14e930844e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a13d6b-fb65-48ce-a0c2-8c5377fba044', 'volume_name': 'volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ddc76b-1061-4931-a7d9-9b7c09392112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ddc76b-1061-4931-a7d9-9b7c09392112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dccd998-f987-465d-af51-36898c7df5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:31 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume 72a13d6b-fb65-48ce-a0c2-8c5377fba044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044', 'volume_size': 1} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD" returned: 0 in 0.542s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] 58cd658a-6d16-40ff-85de-7b9a03ec1256 was qcow2, converting to raw {{(pid=87217) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-88492238-0718-412d-90c2-ef165d37a9c8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:31 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 Jul 15 18:42:31 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:31 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-88492238-0718-412d-90c2-ef165d37a9c8 Jul 15 18:42:31 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Flow 'volume_create_manager' (0378f1ec-6909-4407-86ba-265a1b8be57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66de4a26-8bcd-4b72-922d-e350320bbe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66de4a26-8bcd-4b72-922d-e350320bbe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-613953107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94d9c49-bf5c-4916-b479-5d7320eb7e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f3fe39bf15497c8a5b8fbc3aed96bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:32Z,use_quota=True,user_id='086795c2797f4016afcff7555e9eefdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565531bb-a8f1-4a96-9ad5-5d810e766814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565531bb-a8f1-4a96-9ad5-5d810e766814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffc8fa9-283f-4d95-8746-bcb56350e540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffc8fa9-283f-4d95-8746-bcb56350e540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e94d9c49-bf5c-4916-b479-5d7320eb7e11', 'volume_name': 'volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6090fd48-fafc-40a8-a31c-4a6cd3d99f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6090fd48-fafc-40a8-a31c-4a6cd3d99f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9904ae-1966-4030-b0cb-fc6e8a654b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:31 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume e94d9c49-bf5c-4916-b479-5d7320eb7e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11', 'volume_size': 1} Jul 15 18:42:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:32 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-88492238-0718-412d-90c2-ef165d37a9c8" returned: 0 in 0.447s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1271868006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a13d6b-fb65-48ce-a0c2-8c5377fba044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f3fe39bf15497c8a5b8fbc3aed96bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:31Z,use_quota=True,user_id='086795c2797f4016afcff7555e9eefdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Creating volume 72a13d6b-fb65-48ce-a0c2-8c5377fba044 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:32 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1db99d-cc6a-4272-883d-bdedb02926f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88492238-0718-412d-90c2-ef165d37a9c8', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f791d36-a4c2-4dd2-bb4a-e9c7916ef5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:32 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044 1073741824 Jul 15 18:42:32 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:32 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume volume-88492238-0718-412d-90c2-ef165d37a9c8 (88492238-0718-412d-90c2-ef165d37a9c8): created successfully Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f791d36-a4c2-4dd2-bb4a-e9c7916ef5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Flow 'volume_create_manager' (f85ee67b-248b-4393-87d5-fb4236da635e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:32 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e688007a-2071-445d-9157-061c7d83da44 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created volume successfully. Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Flow 'volume_create_manager' (25c9d9d5-7b65-49b3-97c5-ab7b274d8bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1adf39-f10b-4fff-be81-e7376dd1b361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1adf39-f10b-4fff-be81-e7376dd1b361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-994512269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d4fd93-cd1c-43d7-8509-93338974de02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f3fe39bf15497c8a5b8fbc3aed96bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:32Z,use_quota=True,user_id='086795c2797f4016afcff7555e9eefdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86497bd5-cfd9-4dbe-8b97-1920f7fdd020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86497bd5-cfd9-4dbe-8b97-1920f7fdd020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e98715a-8da0-477b-8f8e-6f75c7765407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e98715a-8da0-477b-8f8e-6f75c7765407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d4fd93-cd1c-43d7-8509-93338974de02', 'volume_name': 'volume-f1d4fd93-cd1c-43d7-8509-93338974de02', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0871c30f-b4bb-41fb-bf67-662ecf707218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0871c30f-b4bb-41fb-bf67-662ecf707218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929a7486-ca78-4e83-b225-95edefec664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:32 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume f1d4fd93-cd1c-43d7-8509-93338974de02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d4fd93-cd1c-43d7-8509-93338974de02', 'volume_size': 1} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:32 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:42:32 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:32 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044 1073741824" returned: 0 in 0.907s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:33 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044 Jul 15 18:42:33 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:33 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.449s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Flow 'volume_create_manager' (f4a83476-b6be-410e-9d62-f8cf71f70f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5760039-f76a-4085-a061-2a2597eb3e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5760039-f76a-4085-a061-2a2597eb3e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469052885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac9229f-4a06-489e-851b-f0903715d9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f3fe39bf15497c8a5b8fbc3aed96bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:33Z,use_quota=True,user_id='086795c2797f4016afcff7555e9eefdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c790d466-95b4-4827-9e35-3a8923392c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c790d466-95b4-4827-9e35-3a8923392c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01876134-f8a6-4615-a517-188e510d1d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01876134-f8a6-4615-a517-188e510d1d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aac9229f-4a06-489e-851b-f0903715d9d9', 'volume_name': 'volume-aac9229f-4a06-489e-851b-f0903715d9d9', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4813665-adc3-4e37-b585-037ed6a7ada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:33 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4813665-adc3-4e37-b585-037ed6a7ada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9042911b-e7a8-47ac-9e0e-09c20dd6280f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:33 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume aac9229f-4a06-489e-851b-f0903715d9d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aac9229f-4a06-489e-851b-f0903715d9d9', 'volume_size': 1} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044" returned: 0 in 0.369s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-613953107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94d9c49-bf5c-4916-b479-5d7320eb7e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f3fe39bf15497c8a5b8fbc3aed96bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:32Z,use_quota=True,user_id='086795c2797f4016afcff7555e9eefdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Creating volume e94d9c49-bf5c-4916-b479-5d7320eb7e11 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:33 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:33 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11 1073741824 Jul 15 18:42:33 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dccd998-f987-465d-af51-36898c7df5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705dd842-0941-4e35-9bbd-b160ca3abc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:33 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044 (72a13d6b-fb65-48ce-a0c2-8c5377fba044): created successfully Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705dd842-0941-4e35-9bbd-b160ca3abc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Flow 'volume_create_manager' (b414016f-e722-4a62-9818-50e08421d4c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:33 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c806e76b-f08b-4ae9-aa93-7c571d6f12da tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created volume successfully. Jul 15 18:42:34 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86" returned: 0 in 2.481s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_b4rur5btdevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:42:34 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:34 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Converted 112.00 MB image at 45.12 MB/s Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11 1073741824" returned: 0 in 0.612s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:34 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 1G Jul 15 18:42:34 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:34 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11 Jul 15 18:42:34 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:34 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 1G" returned: 0 in 0.426s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d50a4ae-6b94-404f-93d5-a59907f733fb]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:34 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11" returned: 0 in 0.424s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.982s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-994512269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d4fd93-cd1c-43d7-8509-93338974de02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f3fe39bf15497c8a5b8fbc3aed96bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:32Z,use_quota=True,user_id='086795c2797f4016afcff7555e9eefdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Creating volume f1d4fd93-cd1c-43d7-8509-93338974de02 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:34 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1d4fd93-cd1c-43d7-8509-93338974de02 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:34 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1d4fd93-cd1c-43d7-8509-93338974de02 1073741824 Jul 15 18:42:34 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9904ae-1966-4030-b0cb-fc6e8a654b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa27eb04-661d-4986-a18c-ba32d54a0c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:34 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11 (e94d9c49-bf5c-4916-b479-5d7320eb7e11): created successfully Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa27eb04-661d-4986-a18c-ba32d54a0c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:34 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 Jul 15 18:42:34 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Flow 'volume_create_manager' (0378f1ec-6909-4407-86ba-265a1b8be57f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:34 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-fa645c9b-2500-40ca-a07d-460c3f9f2abb tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created volume successfully. Jul 15 18:42:34 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86" returned: 0 in 0.360s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:34 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 Jul 15 18:42:34 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:35 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1d4fd93-cd1c-43d7-8509-93338974de02 1073741824" returned: 0 in 0.487s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1d4fd93-cd1c-43d7-8509-93338974de02 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:35 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1d4fd93-cd1c-43d7-8509-93338974de02 Jul 15 18:42:35 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:35 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86" returned: 1 in 0.408s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Downloaded image 58cd658a-6d16-40ff-85de-7b9a03ec1256 ((None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}])) to volume 50e0cf9d-374c-4852-9092-21172d6efb86 successfully. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Temporary image 58cd658a-6d16-40ff-85de-7b9a03ec1256 for user edf5830448484888811082baf3c3b4fc is deleted. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Marking volume 50e0cf9d-374c-4852-9092-21172d6efb86 as bootable. {{(pid=87217) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Copying metadata from image 58cd658a-6d16-40ff-85de-7b9a03ec1256 to 50e0cf9d-374c-4852-9092-21172d6efb86. {{(pid=87217) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Creating volume glance metadata for volume 50e0cf9d-374c-4852-9092-21172d6efb86 backed by image 58cd658a-6d16-40ff-85de-7b9a03ec1256 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87217) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd42bba9-6b8c-4df7-bdd4-967d2de7335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e0cf9d-374c-4852-9092-21172d6efb86', 'volume_size': 1, 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1cc7d7f865b4961944a3804db21f9fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'created_at': datetime.datetime(2026, 7, 15, 16, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58cd658a-6d16-40ff-85de-7b9a03ec1256/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4814b67-2d4c-4f43-bf7c-25b28f201735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:35 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1d4fd93-cd1c-43d7-8509-93338974de02" returned: 0 in 0.412s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.079s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469052885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac9229f-4a06-489e-851b-f0903715d9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f3fe39bf15497c8a5b8fbc3aed96bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:33Z,use_quota=True,user_id='086795c2797f4016afcff7555e9eefdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Creating volume aac9229f-4a06-489e-851b-f0903715d9d9 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:35 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aac9229f-4a06-489e-851b-f0903715d9d9 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:35 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Volume volume-50e0cf9d-374c-4852-9092-21172d6efb86 (50e0cf9d-374c-4852-9092-21172d6efb86): created successfully Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4814b67-2d4c-4f43-bf7c-25b28f201735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Flow 'volume_create_manager' (fd1baa58-fa03-4fac-abb1-ee5152f9a5f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:35 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aac9229f-4a06-489e-851b-f0903715d9d9 1073741824 Jul 15 18:42:35 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929a7486-ca78-4e83-b225-95edefec664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d4fd93-cd1c-43d7-8509-93338974de02', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6a59ff-2b4e-4b8b-a4bb-172d46df2c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:35 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e71f2b47-21dd-43da-8f56-85b85f080364 tempest-VolumesImageMetadata-320986410 None] Created volume successfully. Jul 15 18:42:35 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume volume-f1d4fd93-cd1c-43d7-8509-93338974de02 (f1d4fd93-cd1c-43d7-8509-93338974de02): created successfully Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6a59ff-2b4e-4b8b-a4bb-172d46df2c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Flow 'volume_create_manager' (25c9d9d5-7b65-49b3-97c5-ab7b274d8bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:35 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4cdc0e3e-78d1-43f7-9dd2-1f9b689b8e3c tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created volume successfully. Jul 15 18:42:36 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aac9229f-4a06-489e-851b-f0903715d9d9 1073741824" returned: 0 in 0.641s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aac9229f-4a06-489e-851b-f0903715d9d9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:36 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aac9229f-4a06-489e-851b-f0903715d9d9 Jul 15 18:42:36 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:36 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aac9229f-4a06-489e-851b-f0903715d9d9" returned: 0 in 0.283s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9042911b-e7a8-47ac-9e0e-09c20dd6280f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aac9229f-4a06-489e-851b-f0903715d9d9', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84089d2b-2bb5-4400-a9db-c8cb1a0ec357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:36 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Volume volume-aac9229f-4a06-489e-851b-f0903715d9d9 (aac9229f-4a06-489e-851b-f0903715d9d9): created successfully Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84089d2b-2bb5-4400-a9db-c8cb1a0ec357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Flow 'volume_create_manager' (f4a83476-b6be-410e-9d62-f8cf71f70f14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:36 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-da18382c-92d1-4204-b816-d4e4852769c0 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created volume successfully. Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-aac9229f-4a06-489e-851b-f0903715d9d9-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-aac9229f-4a06-489e-851b-f0903715d9d9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-quobyte-aac9229f-4a06-489e-851b-f0903715d9d9" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-aac9229f-4a06-489e-851b-f0903715d9d9" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Acquiring lock "cinder-50e0cf9d-374c-4852-9092-21172d6efb86-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[68723332-a261-44a2-892e-2ff1296582c2]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aac9229f-4a06-489e-851b-f0903715d9d9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Lock "cinder-50e0cf9d-374c-4852-9092-21172d6efb86-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Acquiring lock "cinder-quobyte-50e0cf9d-374c-4852-9092-21172d6efb86" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Lock "cinder-quobyte-50e0cf9d-374c-4852-9092-21172d6efb86" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:37 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aac9229f-4a06-489e-851b-f0903715d9d9 Jul 15 18:42:37 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc2881c-fe77-4afa-9d73-4c4ebde8c5fe]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:37 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 Jul 15 18:42:37 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:37 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aac9229f-4a06-489e-851b-f0903715d9d9" returned: 0 in 0.485s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aac9229f-4a06-489e-851b-f0903715d9d9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:37 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aac9229f-4a06-489e-851b-f0903715d9d9 Jul 15 18:42:37 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:37 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86" returned: 0 in 0.450s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:37 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 Jul 15 18:42:37 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:37 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aac9229f-4a06-489e-851b-f0903715d9d9" returned: 0 in 0.304s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-aac9229f-4a06-489e-851b-f0903715d9d9" released by "delete_volume" :: held 0.874s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created reservations ['8223c672-a6f9-4c29-abcd-c68a15a4d994', '87da25a8-3a98-480a-bf4b-1e2604cca624', '3bd0a833-22d3-4f59-87ed-bbd21a8bd8d3', 'a20b6db5-2629-441e-86dc-921e2d89f194'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:37 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:42:37 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-f1d4fd93-cd1c-43d7-8509-93338974de02-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-f1d4fd93-cd1c-43d7-8509-93338974de02-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:38 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86" returned: 1 in 0.525s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-quobyte-f1d4fd93-cd1c-43d7-8509-93338974de02" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:38 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86 Jul 15 18:42:38 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-f1d4fd93-cd1c-43d7-8509-93338974de02" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c848397-1ddb-4028-91cc-8bfec4be41b7]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1d4fd93-cd1c-43d7-8509-93338974de02 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:38 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.357s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:38 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Deleted volume successfully. Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b724b1e-4287-4cda-8867-c89ba907476b tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-aac9229f-4a06-489e-851b-f0903715d9d9-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:38 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1d4fd93-cd1c-43d7-8509-93338974de02 Jul 15 18:42:38 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:38 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-50e0cf9d-374c-4852-9092-21172d6efb86" returned: 0 in 0.330s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Lock "cinder-quobyte-50e0cf9d-374c-4852-9092-21172d6efb86" released by "delete_volume" :: held 1.378s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Created reservations ['feb09a6a-ff25-479b-8b97-12556f9a4ea3', 'b4f80ec8-c0b0-419a-90a1-e348bec0273c', 'b875b84d-5ec0-4909-b6c5-8bcdd371b7b3', '7327850c-bd2a-43df-83b7-c9c99a6076d0'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:38 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:42:38 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:38 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1d4fd93-cd1c-43d7-8509-93338974de02" returned: 0 in 0.448s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1d4fd93-cd1c-43d7-8509-93338974de02 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:38 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1d4fd93-cd1c-43d7-8509-93338974de02 Jul 15 18:42:38 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:38 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.286s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:38 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Deleted volume successfully. Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d6037341-a89a-424c-a014-f7e9fddf98fa tempest-VolumesImageMetadata-320986410 None] Lock "cinder-50e0cf9d-374c-4852-9092-21172d6efb86-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:38 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1d4fd93-cd1c-43d7-8509-93338974de02" returned: 0 in 0.279s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-f1d4fd93-cd1c-43d7-8509-93338974de02" released by "delete_volume" :: held 0.778s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:38 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created reservations ['698bad7d-1568-4671-bee5-a547ed35e0b5', 'b7540ba9-e544-4912-b0fc-bf5400256f93', 'fdea40e2-edf0-4823-92fb-181cb82639eb', '737788b9-052c-4397-a402-eca94ed7466a'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:39 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:42:39 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-e94d9c49-bf5c-4916-b479-5d7320eb7e11-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-e94d9c49-bf5c-4916-b479-5d7320eb7e11-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-quobyte-e94d9c49-bf5c-4916-b479-5d7320eb7e11" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:39 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.309s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-e94d9c49-bf5c-4916-b479-5d7320eb7e11" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:39 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Deleted volume successfully. Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d1c3a3-85ac-4bba-a308-9c1e6d3c0597]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-58af3a50-b299-47f4-b0dd-0b999eb3dc02 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-f1d4fd93-cd1c-43d7-8509-93338974de02-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:39 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11 Jul 15 18:42:39 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:39 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11" returned: 0 in 0.427s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:39 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11 Jul 15 18:42:39 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:40 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e94d9c49-bf5c-4916-b479-5d7320eb7e11" returned: 0 in 0.295s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-e94d9c49-bf5c-4916-b479-5d7320eb7e11" released by "delete_volume" :: held 0.788s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created reservations ['6798d0bc-557c-435a-a070-614d84ec4a1a', '52148be3-5a38-4498-926b-6cf28b320771', '45cdea4d-067e-4419-b1c4-fcf6d3e147ad', '85158669-bf58-4958-a835-dfe68f9dc34b'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:40 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:42:40 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-72a13d6b-fb65-48ce-a0c2-8c5377fba044-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-72a13d6b-fb65-48ce-a0c2-8c5377fba044-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-quobyte-72a13d6b-fb65-48ce-a0c2-8c5377fba044" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-72a13d6b-fb65-48ce-a0c2-8c5377fba044" acquired by "delete_volume" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6851c83e-5344-41e0-a7c8-a309c6265599]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:40 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.382s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:40 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Deleted volume successfully. Jul 15 18:42:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-349fdffc-f0bf-40a7-9b33-699af18a4f47 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-e94d9c49-bf5c-4916-b479-5d7320eb7e11-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:40 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044 Jul 15 18:42:40 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:41 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044" returned: 0 in 0.502s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:41 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044 Jul 15 18:42:41 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:41 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-72a13d6b-fb65-48ce-a0c2-8c5377fba044" returned: 0 in 0.312s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-72a13d6b-fb65-48ce-a0c2-8c5377fba044" released by "delete_volume" :: held 0.881s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created reservations ['58739454-5ce3-4a37-9675-c420f3b718a2', 'f8d0e81a-cb0d-4013-af7f-c6fa93fd34af', '4ebba32d-0209-4c47-bb8f-f8ebb645d78a', '098c5276-322f-464a-9d67-32c68723b3f3'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:41 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:42:41 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-88492238-0718-412d-90c2-ef165d37a9c8-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-88492238-0718-412d-90c2-ef165d37a9c8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-quobyte-88492238-0718-412d-90c2-ef165d37a9c8" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-88492238-0718-412d-90c2-ef165d37a9c8" acquired by "delete_volume" :: waited 0.057s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:42 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[7359a405-fc52-42e7-87b7-8878ae2e78af]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-88492238-0718-412d-90c2-ef165d37a9c8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:42 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.586s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:42 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:42 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Deleted volume successfully. Jul 15 18:42:42 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-88492238-0718-412d-90c2-ef165d37a9c8 Jul 15 18:42:42 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-67883128-32c0-4ac9-910f-fc1a4ef30b66 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-72a13d6b-fb65-48ce-a0c2-8c5377fba044-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:42 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-88492238-0718-412d-90c2-ef165d37a9c8" returned: 0 in 0.577s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-88492238-0718-412d-90c2-ef165d37a9c8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:42 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-88492238-0718-412d-90c2-ef165d37a9c8 Jul 15 18:42:42 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:43 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-88492238-0718-412d-90c2-ef165d37a9c8" returned: 0 in 0.321s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-88492238-0718-412d-90c2-ef165d37a9c8" released by "delete_volume" :: held 0.994s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:43 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created reservations ['338d31dd-8303-4cf1-a519-130fab85cba3', '4b99b88a-4d3f-4f10-be45-b3beec0714ec', '8611d80d-da05-47a7-aefb-0cb077d3c31d', '5f0f80af-c22d-452c-8512-6bdfe0773d45'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:43 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:42:43 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:43 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.275s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:43 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:43 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Deleted volume successfully. Jul 15 18:42:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a96a14e4-0833-4495-9fe5-840dec8cfd05 tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-88492238-0718-412d-90c2-ef165d37a9c8-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-e28852de-ae5c-4775-b4ed-5dcc2411edbe-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-e28852de-ae5c-4775-b4ed-5dcc2411edbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-quobyte-7b9c86e0-5a76-474d-afe7-2ff272daea06" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-7b9c86e0-5a76-474d-afe7-2ff272daea06" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-quobyte-e28852de-ae5c-4775-b4ed-5dcc2411edbe" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-e28852de-ae5c-4775-b4ed-5dcc2411edbe" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Deleting offline snapshot e28852de-ae5c-4775-b4ed-5dcc2411edbe of volume 7b9c86e0-5a76-474d-afe7-2ff272daea06 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] snapshot_file for this snap is: volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf06ab4d-bd59-418d-9e31-55fef42b80dd]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:44 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe Jul 15 18:42:44 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Flow 'volume_create_manager' (0e1aa2d4-2a43-48df-b117-869298efdf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7a8513-f4eb-4675-9ee2-6db8bb769279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7a8513-f4eb-4675-9ee2-6db8bb769279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1575930899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94faca9f-22b1-4510-9611-cc420322ad82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a1e798fc2c4dbaaf96737388442941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:45Z,use_quota=True,user_id='d20395a7e36d4647b8dc0f2d54600487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c60556-df63-4a1e-82ea-858f1b4912e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c60556-df63-4a1e-82ea-858f1b4912e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86afb3f4-04eb-427e-a820-8122a6348048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86afb3f4-04eb-427e-a820-8122a6348048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94faca9f-22b1-4510-9611-cc420322ad82', 'volume_name': 'volume-94faca9f-22b1-4510-9611-cc420322ad82', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fe1489-31ac-4881-bcf7-eda75d8203bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fe1489-31ac-4881-bcf7-eda75d8203bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576c0a83-5d5b-4a79-9846-66d92eed5291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:44 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Volume 94faca9f-22b1-4510-9611-cc420322ad82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94faca9f-22b1-4510-9611-cc420322ad82', 'volume_size': 1} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1575930899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94faca9f-22b1-4510-9611-cc420322ad82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a1e798fc2c4dbaaf96737388442941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:45Z,use_quota=True,user_id='d20395a7e36d4647b8dc0f2d54600487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Creating volume 94faca9f-22b1-4510-9611-cc420322ad82 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:44 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94faca9f-22b1-4510-9611-cc420322ad82 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:44 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94faca9f-22b1-4510-9611-cc420322ad82 1073741824 Jul 15 18:42:44 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:44 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe" returned: 0 in 0.465s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b9c86e0-5a76-474d-afe7-2ff272daea06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f99ac3-1360-4bca-9b28-ed55beb3436b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:45 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 Jul 15 18:42:45 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:45 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94faca9f-22b1-4510-9611-cc420322ad82 1073741824" returned: 0 in 0.846s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94faca9f-22b1-4510-9611-cc420322ad82 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:45 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:45 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94faca9f-22b1-4510-9611-cc420322ad82 Jul 15 18:42:45 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06" returned: 0 in 0.790s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:45 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe Jul 15 18:42:45 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:46 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94faca9f-22b1-4510-9611-cc420322ad82" returned: 0 in 0.562s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576c0a83-5d5b-4a79-9846-66d92eed5291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94faca9f-22b1-4510-9611-cc420322ad82', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:46 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13a7d69-6c7a-4066-a55c-2c9c3f7ee51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe" returned: 0 in 0.553s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:46 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Volume volume-94faca9f-22b1-4510-9611-cc420322ad82 (94faca9f-22b1-4510-9611-cc420322ad82): created successfully Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13a7d69-6c7a-4066-a55c-2c9c3f7ee51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Flow 'volume_create_manager' (0e1aa2d4-2a43-48df-b117-869298efdf91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:46 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe Jul 15 18:42:46 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:46 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c59117fc-a2ce-4696-ada8-1c9fa2381ac6 tempest-AbsoluteLimitsTests-562430430 None] Created volume successfully. Jul 15 18:42:46 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06.e28852de-ae5c-4775-b4ed-5dcc2411edbe" returned: 0 in 0.327s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-e28852de-ae5c-4775-b4ed-5dcc2411edbe" released by "_delete_snapshot" :: held 2.308s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-7b9c86e0-5a76-474d-afe7-2ff272daea06" released by "delete_snapshot" :: held 2.342s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created reservations ['89b05600-3f02-4549-88d7-87300a75fd70', 'a3ca4922-74bc-4bab-b44d-de0c93d00085', '4837b547-0bd4-4432-bc9e-5abeb46e7385', '675618e9-251f-4965-bee2-97d494557326'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Acquiring lock "cinder-94faca9f-22b1-4510-9611-cc420322ad82-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Lock "cinder-94faca9f-22b1-4510-9611-cc420322ad82-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:46 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Delete snapshot completed successfully. Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ad94498d-454a-40e4-ac3c-a39795a466aa tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-e28852de-ae5c-4775-b4ed-5dcc2411edbe-delete_snapshot" released by "delete_snapshot" :: held 2.638s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Acquiring lock "cinder-quobyte-94faca9f-22b1-4510-9611-cc420322ad82" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Lock "cinder-quobyte-94faca9f-22b1-4510-9611-cc420322ad82" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed15d8a6-6270-440a-ab10-991471f0ba07]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94faca9f-22b1-4510-9611-cc420322ad82 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:47 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94faca9f-22b1-4510-9611-cc420322ad82 Jul 15 18:42:47 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:47 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94faca9f-22b1-4510-9611-cc420322ad82" returned: 0 in 0.386s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94faca9f-22b1-4510-9611-cc420322ad82 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:47 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94faca9f-22b1-4510-9611-cc420322ad82 Jul 15 18:42:47 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-7b9c86e0-5a76-474d-afe7-2ff272daea06-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-7b9c86e0-5a76-474d-afe7-2ff272daea06-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "cinder-quobyte-7b9c86e0-5a76-474d-afe7-2ff272daea06" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-7b9c86e0-5a76-474d-afe7-2ff272daea06" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab7379a-e2fa-4453-8a16-cea990684ed7]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:47 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-94faca9f-22b1-4510-9611-cc420322ad82" returned: 0 in 0.404s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Lock "cinder-quobyte-94faca9f-22b1-4510-9611-cc420322ad82" released by "delete_volume" :: held 0.854s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:47 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 Jul 15 18:42:47 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:47 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Created reservations ['54fe8309-395a-4bb2-8c97-2d194a810f91', 'ed352820-0d2f-4c5d-86c2-f1d76a795a16', '8498bae0-1598-440e-85a8-8afcb183a874', '9649a5a0-4ebf-45d8-b743-bd0ffdafeed5'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:48 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:42:48 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:48 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06" returned: 0 in 0.619s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:48 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06 Jul 15 18:42:48 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:48 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.458s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:48 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Deleted volume successfully. Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d727b539-b9d9-4196-a017-4ee68d8b3770 tempest-AbsoluteLimitsTests-562430430 None] Lock "cinder-94faca9f-22b1-4510-9611-cc420322ad82-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:48 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7b9c86e0-5a76-474d-afe7-2ff272daea06" returned: 0 in 0.353s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-quobyte-7b9c86e0-5a76-474d-afe7-2ff272daea06" released by "delete_volume" :: held 1.068s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:48 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Created reservations ['5ee7c326-ec10-47c3-a5ad-08286ebacb16', '28a379df-b6aa-47f1-aa8d-67d7c7e9b90c', '87dd8080-e00f-4d60-99e8-cdacaebde352', '7ccd1b20-3b02-49a6-9ca3-47d251525762'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:42:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:49 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:42:49 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:49 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.303s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:49 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:42:49 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Deleted volume successfully. Jul 15 18:42:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-33522f66-f35d-4d44-bf75-8aa1d2e42f8e tempest-CreateVolumesFromSnapshotTest-1240436081 None] Lock "cinder-7b9c86e0-5a76-474d-afe7-2ff272daea06-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:42:53 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Flow 'volume_create_manager' (f2a5fb30-d6ad-429b-ab0f-1111f2d517af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3b4851-25b2-44a0-a002-1bbdfa322906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3b4851-25b2-44a0-a002-1bbdfa322906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1506251338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d29947b-9b13-4d3e-9302-b48423d51521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9d959cdecd4ead82f403f553612313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:54Z,use_quota=True,user_id='84c89cc73d8a45f09a3546fb8c2e1145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43865b5-2d30-4c05-8743-373bfe66495a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43865b5-2d30-4c05-8743-373bfe66495a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b150c548-bec9-435b-88af-4a3049d2f0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b150c548-bec9-435b-88af-4a3049d2f0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d29947b-9b13-4d3e-9302-b48423d51521', 'volume_name': 'volume-5d29947b-9b13-4d3e-9302-b48423d51521', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224b07de-9db4-402a-84a2-92ae85872267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224b07de-9db4-402a-84a2-92ae85872267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80821c39-c820-4b9d-aea8-0dfd8650d3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:54 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Volume 5d29947b-9b13-4d3e-9302-b48423d51521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d29947b-9b13-4d3e-9302-b48423d51521', 'volume_size': 1} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1506251338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d29947b-9b13-4d3e-9302-b48423d51521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9d959cdecd4ead82f403f553612313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:54Z,use_quota=True,user_id='84c89cc73d8a45f09a3546fb8c2e1145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Creating volume 5d29947b-9b13-4d3e-9302-b48423d51521 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:54 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:54 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 1073741824 Jul 15 18:42:54 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:54 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 1073741824" returned: 0 in 0.460s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:54 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 Jul 15 18:42:54 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:54 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521" returned: 0 in 0.276s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80821c39-c820-4b9d-aea8-0dfd8650d3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d29947b-9b13-4d3e-9302-b48423d51521', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad22446-4bf3-4783-b150-6482ccf0e38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:54 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Volume volume-5d29947b-9b13-4d3e-9302-b48423d51521 (5d29947b-9b13-4d3e-9302-b48423d51521): created successfully Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad22446-4bf3-4783-b150-6482ccf0e38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:54 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Flow 'volume_create_manager' (f2a5fb30-d6ad-429b-ab0f-1111f2d517af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-38688547-70e6-4d3a-9ec9-e493c43bb4ab tempest-VolumesDeleteCascade-388007155 None] Created volume successfully. Jul 15 18:42:55 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Flow 'volume_create_manager' (6272432c-3609-4e63-ae31-222e2b9531d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fb6e05-1b85-4d06-ba37-efde3ac85534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fb6e05-1b85-4d06-ba37-efde3ac85534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd563142-5ef9-497a-adaa-0b7431feac2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4ec511c36040d4b77e8bdfbeb792c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:56Z,use_quota=True,user_id='ad94f76e5a6a4bf18c0548dbeec4ef92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed63c559-0418-4e61-b179-aee1dd20e32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed63c559-0418-4e61-b179-aee1dd20e32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cbf5ae-2a41-4350-a0a9-c0fc466f3d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.image.glance [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Creating Keystone auth plugin from conf {{(pid=87217) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] Creating offline snapshot 99a35434-b4dc-45d0-bdae-3a50d77444d1 of volume 5d29947b-9b13-4d3e-9302-b48423d51521 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[968f9f72-cd74-4cbe-b8d6-a4e7fa74776f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cbf5ae-2a41-4350-a0a9-c0fc466f3d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd563142-5ef9-497a-adaa-0b7431feac2d', 'volume_name': 'volume-dd563142-5ef9-497a-adaa-0b7431feac2d', 'volume_size': 1, 'image_id': 'b1095034-0990-493c-888b-a13271ef2efa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1095034-0990-493c-888b-a13271ef2efa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d5b03dc668eed226e2ddb697cc407e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8e4ec511c36040d4b77e8bdfbeb792c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8fd5b8d9ebf4fa77d8fe5214253c5aeb3ccf1cd622cb4fe503d1d7749d4c6c20afb5d912a94360800b58d85f2691ebec0da68cf0f4bcbc35e8e4c4dae22791b4', 'id': 'b1095034-0990-493c-888b-a13271ef2efa', 'created_at': datetime.datetime(2026, 7, 15, 16, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 42, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1095034-0990-493c-888b-a13271ef2efa/file', 'properties': {}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:56 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 Jul 15 18:42:56 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ea6324-5da0-494b-a820-a38e51026bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ea6324-5da0-494b-a820-a38e51026bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d982dc5-f703-4f90-81df-dd61044e4641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:42:56 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Volume dd563142-5ef9-497a-adaa-0b7431feac2d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd563142-5ef9-497a-adaa-0b7431feac2d', 'volume_size': 1, 'image_id': 'b1095034-0990-493c-888b-a13271ef2efa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1095034-0990-493c-888b-a13271ef2efa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d5b03dc668eed226e2ddb697cc407e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8e4ec511c36040d4b77e8bdfbeb792c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8fd5b8d9ebf4fa77d8fe5214253c5aeb3ccf1cd622cb4fe503d1d7749d4c6c20afb5d912a94360800b58d85f2691ebec0da68cf0f4bcbc35e8e4c4dae22791b4', 'id': 'b1095034-0990-493c-888b-a13271ef2efa', 'created_at': datetime.datetime(2026, 7, 15, 16, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 42, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1095034-0990-493c-888b-a13271ef2efa/file', 'properties': {}}, 'image_service': } Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Trying to clone dd563142-5ef9-497a-adaa-0b7431feac2d from image b1095034-0990-493c-888b-a13271ef2efa at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1095034-0990-493c-888b-a13271ef2efa', 'metadata': {}}]). {{(pid=87217) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:42:56 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Image download 0.00 MB at 0.00 MB/s Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25a2396-51f4-4b95-82b4-f68b9f2805c0]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:56 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521" returned: 0 in 0.429s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:56 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD Jul 15 18:42:56 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:56 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 1G Jul 15 18:42:56 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:57 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:57 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD Jul 15 18:42:57 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:57 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 1G" returned: 0 in 0.426s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d29947b-9b13-4d3e-9302-b48423d51521 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:57 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d29947b-9b13-4d3e-9302-b48423d51521 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 Jul 15 18:42:57 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:57 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Temporary image b1095034-0990-493c-888b-a13271ef2efa is fetched for user ad94f76e5a6a4bf18c0548dbeec4ef92. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d3877d-32d0-45a5-b49f-508c3b6c218e]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:57 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d29947b-9b13-4d3e-9302-b48423d51521 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1" returned: 0 in 0.346s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:57 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 is being set with open permissions: ugo+rw Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:57 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 Jul 15 18:42:57 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:57 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD Jul 15 18:42:57 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:57 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1" returned: 0 in 0.263s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:57 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:57 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.info Jul 15 18:42:57 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:57 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD Jul 15 18:42:57 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:58 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.info" returned: 0 in 0.274s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:58 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.info is being set with open permissions: ugo+rw Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:58 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.info Jul 15 18:42:58 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:58 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:58 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.info" returned: 0 in 0.275s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.192s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd563142-5ef9-497a-adaa-0b7431feac2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4ec511c36040d4b77e8bdfbeb792c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:42:56Z,use_quota=True,user_id='ad94f76e5a6a4bf18c0548dbeec4ef92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Creating volume dd563142-5ef9-497a-adaa-0b7431feac2d {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:42:58 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:58 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d 1073741824 Jul 15 18:42:58 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8ffe3c90-9229-4151-9662-5bca9cbe7d14 tempest-VolumesDeleteCascade-388007155 None] Create snapshot completed successfully Jul 15 18:42:58 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d 1073741824" returned: 0 in 0.456s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:58 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d Jul 15 18:42:58 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:59 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d" returned: 0 in 0.263s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Attempting download of b1095034-0990-493c-888b-a13271ef2efa ((None, [{'url': 'file:///opt/stack/data/glance/images/b1095034-0990-493c-888b-a13271ef2efa', 'metadata': {}}])) to volume dd563142-5ef9-497a-adaa-0b7431feac2d. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[77333c83-184f-42a2-b3d0-b4cf1cee4a9a]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1095034-0990-493c-888b-a13271ef2efa_u93l3ie2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:59 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1095034-0990-493c-888b-a13271ef2efa_u93l3ie2 Jul 15 18:42:59 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:59 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1095034-0990-493c-888b-a13271ef2efa_u93l3ie2" returned: 0 in 0.323s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1095034-0990-493c-888b-a13271ef2efa_u93l3ie2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] Creating offline snapshot 7cf2041b-585c-4ba7-b985-04749e20b5a8 of volume 5d29947b-9b13-4d3e-9302-b48423d51521 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a452bf-62ba-4605-8efc-7358e15fea13]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:42:59 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1095034-0990-493c-888b-a13271ef2efa_u93l3ie2 Jul 15 18:42:59 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:59 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 Jul 15 18:42:59 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:42:59 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1095034-0990-493c-888b-a13271ef2efa_u93l3ie2" returned: 1 in 0.323s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1095034-0990-493c-888b-a13271ef2efa_u93l3ie2' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2b5b93-bdd2-450b-a270-7ea7508712ac]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:42:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:00 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD Jul 15 18:43:00 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:00 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1" returned: 0 in 0.373s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d29947b-9b13-4d3e-9302-b48423d51521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:00 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 1G Jul 15 18:43:00 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:00 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:00 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD Jul 15 18:43:00 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:00 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 1G" returned: 0 in 0.428s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:00 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 Jul 15 18:43:00 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:00 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] b1095034-0990-493c-888b-a13271ef2efa was raw, converting to raw {{(pid=87217) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:00 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d Jul 15 18:43:00 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:00 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8" returned: 0 in 0.274s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:00 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 is being set with open permissions: ugo+rw Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:00 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 Jul 15 18:43:00 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:00 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d" returned: 0 in 0.300s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1095034-0990-493c-888b-a13271ef2efa_itdbs2wkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:43:00 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Converted 0.00 MB image at 0.00 MB/s Jul 15 18:43:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:00 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d 1G Jul 15 18:43:00 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:00 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8" returned: 0 in 0.235s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.413s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:01 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0f3ad79d-dc5b-4c68-a199-1eb0293cdf4a tempest-VolumesDeleteCascade-388007155 None] Create snapshot completed successfully Jul 15 18:43:01 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d 1G" returned: 0 in 0.278s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b26a565-75da-4556-b684-55503db7a3cd]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:01 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d Jul 15 18:43:01 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:01 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d" returned: 0 in 0.327s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:01 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d Jul 15 18:43:01 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-5d29947b-9b13-4d3e-9302-b48423d51521-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-5d29947b-9b13-4d3e-9302-b48423d51521-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Performing cascade delete. {{(pid=87217) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-7cf2041b-585c-4ba7-b985-04749e20b5a8-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-7cf2041b-585c-4ba7-b985-04749e20b5a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-quobyte-5d29947b-9b13-4d3e-9302-b48423d51521" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-5d29947b-9b13-4d3e-9302-b48423d51521" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-quobyte-7cf2041b-585c-4ba7-b985-04749e20b5a8" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-7cf2041b-585c-4ba7-b985-04749e20b5a8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Deleting offline snapshot 7cf2041b-585c-4ba7-b985-04749e20b5a8 of volume 5d29947b-9b13-4d3e-9302-b48423d51521 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:43:01 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] snapshot_file for this snap is: volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d" returned: 1 in 0.362s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Downloaded image b1095034-0990-493c-888b-a13271ef2efa ((None, [{'url': 'file:///opt/stack/data/glance/images/b1095034-0990-493c-888b-a13271ef2efa', 'metadata': {}}])) to volume dd563142-5ef9-497a-adaa-0b7431feac2d successfully. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Temporary image b1095034-0990-493c-888b-a13271ef2efa for user ad94f76e5a6a4bf18c0548dbeec4ef92 is deleted. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Marking volume dd563142-5ef9-497a-adaa-0b7431feac2d as bootable. {{(pid=87217) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[569be7ef-557f-4047-8892-508faa4c1d05]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Copying metadata from image b1095034-0990-493c-888b-a13271ef2efa to dd563142-5ef9-497a-adaa-0b7431feac2d. {{(pid=87217) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:43:01 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Creating volume glance metadata for volume dd563142-5ef9-497a-adaa-0b7431feac2d backed by image b1095034-0990-493c-888b-a13271ef2efa with: {'image_id': 'b1095034-0990-493c-888b-a13271ef2efa', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0d5b03dc668eed226e2ddb697cc407e4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87217) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d982dc5-f703-4f90-81df-dd61044e4641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd563142-5ef9-497a-adaa-0b7431feac2d', 'volume_size': 1, 'image_id': 'b1095034-0990-493c-888b-a13271ef2efa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1095034-0990-493c-888b-a13271ef2efa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d5b03dc668eed226e2ddb697cc407e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8e4ec511c36040d4b77e8bdfbeb792c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8fd5b8d9ebf4fa77d8fe5214253c5aeb3ccf1cd622cb4fe503d1d7749d4c6c20afb5d912a94360800b58d85f2691ebec0da68cf0f4bcbc35e8e4c4dae22791b4', 'id': 'b1095034-0990-493c-888b-a13271ef2efa', 'created_at': datetime.datetime(2026, 7, 15, 16, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 42, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1095034-0990-493c-888b-a13271ef2efa/file', 'properties': {}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862ada96-ef53-4752-ba4b-630c75a9bc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:02 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Volume volume-dd563142-5ef9-497a-adaa-0b7431feac2d (dd563142-5ef9-497a-adaa-0b7431feac2d): created successfully Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862ada96-ef53-4752-ba4b-630c75a9bc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Flow 'volume_create_manager' (6272432c-3609-4e63-ae31-222e2b9531d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:02 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c29b42ed-de20-4d96-b747-cbe887d1fb7a tempest-VolumeImageDependencyTests-896795174 None] Created volume successfully. Jul 15 18:43:02 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 Jul 15 18:43:02 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:02 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8" returned: 0 in 0.376s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d29947b-9b13-4d3e-9302-b48423d51521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0551f3b-c6dc-4201-97eb-5437062b6c51]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Acquiring lock "cinder-dd563142-5ef9-497a-adaa-0b7431feac2d-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Lock "cinder-dd563142-5ef9-497a-adaa-0b7431feac2d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Acquiring lock "cinder-quobyte-dd563142-5ef9-497a-adaa-0b7431feac2d" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:02 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 Jul 15 18:43:02 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Lock "cinder-quobyte-dd563142-5ef9-497a-adaa-0b7431feac2d" acquired by "delete_volume" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d3a9ea-d8f7-4a7c-b07f-146293a47615]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:02 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d Jul 15 18:43:02 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:02 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1" returned: 0 in 0.377s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d29947b-9b13-4d3e-9302-b48423d51521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:02 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 Jul 15 18:43:02 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:02 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d" returned: 0 in 0.359s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:02 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d Jul 15 18:43:02 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:03 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8" returned: 0 in 0.389s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:03 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8 Jul 15 18:43:03 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:03 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d" returned: 1 in 0.376s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:03 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d Jul 15 18:43:03 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:03 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.7cf2041b-585c-4ba7-b985-04749e20b5a8" returned: 0 in 0.273s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-7cf2041b-585c-4ba7-b985-04749e20b5a8" released by "_delete_snapshot" :: held 1.521s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-5d29947b-9b13-4d3e-9302-b48423d51521" released by "delete_snapshot" :: held 1.543s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:03 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-dd563142-5ef9-497a-adaa-0b7431feac2d" returned: 0 in 0.251s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Lock "cinder-quobyte-dd563142-5ef9-497a-adaa-0b7431feac2d" released by "delete_volume" :: held 1.049s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Created reservations ['a5dbf0ef-c2d1-468d-9668-937b8b9354c5', 'd7ee1c88-a850-444e-9184-a3247b604569', '410ccbba-e64a-46c3-9124-6294f26fae8f', 'f83582ab-dd99-487d-ab28-8657f1ca4788'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Created reservations ['c3af2a69-e169-4484-aa65-2c1ac62849a9', '72649211-cc1c-4888-8791-f51cc73a2d4c', '3a078c99-74ad-414b-a2d8-37561d43e697', 'dafa6ad3-49bb-4a09-be26-7b82dda819a5'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Delete snapshot completed successfully. Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-7cf2041b-585c-4ba7-b985-04749e20b5a8-delete_snapshot" released by "delete_snapshot" :: held 1.780s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-99a35434-b4dc-45d0-bdae-3a50d77444d1-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-99a35434-b4dc-45d0-bdae-3a50d77444d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-quobyte-5d29947b-9b13-4d3e-9302-b48423d51521" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-5d29947b-9b13-4d3e-9302-b48423d51521" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-quobyte-99a35434-b4dc-45d0-bdae-3a50d77444d1" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:03 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:03 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-99a35434-b4dc-45d0-bdae-3a50d77444d1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Deleting offline snapshot 99a35434-b4dc-45d0-bdae-3a50d77444d1 of volume 5d29947b-9b13-4d3e-9302-b48423d51521 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] snapshot_file for this snap is: volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[014fdb14-3cc5-4ed5-8d4d-8ea11bfdde74]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:03 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 Jul 15 18:43:03 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:03 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.252s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Deleted volume successfully. Jul 15 18:43:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f117d295-5938-4ee1-a234-3100629623e4 tempest-VolumeImageDependencyTests-896795174 None] Lock "cinder-dd563142-5ef9-497a-adaa-0b7431feac2d-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:04 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1" returned: 0 in 0.386s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:04 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d29947b-9b13-4d3e-9302-b48423d51521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:04 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef073a4b-8815-42b9-b0e3-1284a5eeaf6a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:04 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 Jul 15 18:43:04 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:04 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521" returned: 0 in 0.344s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:04 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 Jul 15 18:43:04 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:04 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1" returned: 0 in 0.352s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:04 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1 Jul 15 18:43:04 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:05 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521.99a35434-b4dc-45d0-bdae-3a50d77444d1" returned: 0 in 0.256s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-99a35434-b4dc-45d0-bdae-3a50d77444d1" released by "_delete_snapshot" :: held 1.425s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-5d29947b-9b13-4d3e-9302-b48423d51521" released by "delete_snapshot" :: held 1.454s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:05 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Created reservations ['258b8f90-c603-4630-893d-036fe4a7ff77', '782fefb3-4d12-49f2-a222-cfb456f9699c', '15815e4b-e633-45be-96b8-b3799a99a36d', '7f429b92-897a-4264-909d-2286cbbe36ef'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:05 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Delete snapshot completed successfully. Jul 15 18:43:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-99a35434-b4dc-45d0-bdae-3a50d77444d1-delete_snapshot" released by "delete_snapshot" :: held 1.628s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Snapshots deleted, issuing volume delete {{(pid=87217) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 15 18:43:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-quobyte-5d29947b-9b13-4d3e-9302-b48423d51521" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-5d29947b-9b13-4d3e-9302-b48423d51521" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:05 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[314e0b8e-bd2a-45a4-9ed7-6a0c77442045]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:05 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 Jul 15 18:43:05 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:05 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521" returned: 0 in 0.395s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:05 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521 Jul 15 18:43:05 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:06 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5d29947b-9b13-4d3e-9302-b48423d51521" returned: 0 in 0.275s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-5d29947b-9b13-4d3e-9302-b48423d51521" released by "delete_volume" :: held 0.751s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:06 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Created reservations ['adbb09f7-8481-48eb-a6c7-5673997ba645', '8abdd324-3dd4-4ac0-9dd8-9931fc48a7b9', '2106ebe5-c1ad-40c4-8a5d-0608a5ce7e16', '88a5d25f-e10a-4b66-ae6e-402cf18c61a6'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:06 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:06 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:06 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.310s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:06 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:06 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Deleted volume successfully. Jul 15 18:43:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e47d88bc-a901-497a-8b80-80c6f9bd284b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-5d29947b-9b13-4d3e-9302-b48423d51521-delete_volume" released by "delete_volume" :: held 4.778s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Flow 'volume_create_manager' (33f6aaf9-b474-46cc-8e46-232f237f71a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7a3463-d7fe-4339-984e-1e79fc52cbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7a3463-d7fe-4339-984e-1e79fc52cbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1078485663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20765a6a-5c19-4b4b-bee9-f0f70316828c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9d959cdecd4ead82f403f553612313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:08Z,use_quota=True,user_id='84c89cc73d8a45f09a3546fb8c2e1145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b189da1-2b0f-418e-960e-c70f54821d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b189da1-2b0f-418e-960e-c70f54821d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc97126c-6885-49ab-92e1-a1a9c083c6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc97126c-6885-49ab-92e1-a1a9c083c6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20765a6a-5c19-4b4b-bee9-f0f70316828c', 'volume_name': 'volume-20765a6a-5c19-4b4b-bee9-f0f70316828c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db757b7e-10ac-4daf-b6be-18a7433671a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db757b7e-10ac-4daf-b6be-18a7433671a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c5ccee-b0b6-4f66-9212-255c688229cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:07 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Volume 20765a6a-5c19-4b4b-bee9-f0f70316828c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20765a6a-5c19-4b4b-bee9-f0f70316828c', 'volume_size': 1} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1078485663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20765a6a-5c19-4b4b-bee9-f0f70316828c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9d959cdecd4ead82f403f553612313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:08Z,use_quota=True,user_id='84c89cc73d8a45f09a3546fb8c2e1145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Creating volume 20765a6a-5c19-4b4b-bee9-f0f70316828c {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:07 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:43:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:08 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c 1073741824 Jul 15 18:43:08 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:08 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c 1073741824" returned: 0 in 0.516s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:08 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c Jul 15 18:43:08 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:08 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Flow 'volume_create_manager' (eb7c2e49-1715-4729-901b-85ab3b9a033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47a3cca-4cb0-4c83-9ab1-80f19cf36f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c" returned: 0 in 0.303s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47a3cca-4cb0-4c83-9ab1-80f19cf36f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794460454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca896ca-f9ca-4375-b0e1-237e8f41eea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6516196535064780bdda193cc93482db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:09Z,use_quota=True,user_id='69b8e43404c242ce83ba48b3fe134c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1024b179-d30e-470a-8dbc-463a7e257fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1024b179-d30e-470a-8dbc-463a7e257fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47b4910-ec0b-411e-a16e-290136dc1102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47b4910-ec0b-411e-a16e-290136dc1102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ca896ca-f9ca-4375-b0e1-237e8f41eea9', 'volume_name': 'volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ce30f8-6f02-496b-889e-2ca365b4daee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ce30f8-6f02-496b-889e-2ca365b4daee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8c36bf-4621-48d8-845b-f53fd6e970f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:08 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Volume 3ca896ca-f9ca-4375-b0e1-237e8f41eea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9', 'volume_size': 1} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794460454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca896ca-f9ca-4375-b0e1-237e8f41eea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6516196535064780bdda193cc93482db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:09Z,use_quota=True,user_id='69b8e43404c242ce83ba48b3fe134c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Creating volume 3ca896ca-f9ca-4375-b0e1-237e8f41eea9 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:08 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c5ccee-b0b6-4f66-9212-255c688229cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20765a6a-5c19-4b4b-bee9-f0f70316828c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:08 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9 1073741824 Jul 15 18:43:08 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d65fa2-7d29-496f-a30f-6e6b10887f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:08 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Volume volume-20765a6a-5c19-4b4b-bee9-f0f70316828c (20765a6a-5c19-4b4b-bee9-f0f70316828c): created successfully Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d65fa2-7d29-496f-a30f-6e6b10887f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Flow 'volume_create_manager' (33f6aaf9-b474-46cc-8e46-232f237f71a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:08 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-054da2e8-2460-4f30-96a2-c16bf0fed1e5 tempest-VolumesDeleteCascade-388007155 None] Created volume successfully. Jul 15 18:43:09 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9 1073741824" returned: 0 in 0.398s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:09 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9 Jul 15 18:43:09 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:09 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9" returned: 0 in 0.232s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:09 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8c36bf-4621-48d8-845b-f53fd6e970f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:09 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f648b1b-2f93-4749-a757-31045af17f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:09 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Volume volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9 (3ca896ca-f9ca-4375-b0e1-237e8f41eea9): created successfully Jul 15 18:43:09 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f648b1b-2f93-4749-a757-31045af17f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:09 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Flow 'volume_create_manager' (eb7c2e49-1715-4729-901b-85ab3b9a033b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:09 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a9f34c7e-f3ac-42f4-9dd0-a59a08a7c9af tempest-ProjectReaderTests-733186929 None] Created volume successfully. Jul 15 18:43:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Acquiring lock "cinder-3ca896ca-f9ca-4375-b0e1-237e8f41eea9-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Lock "cinder-3ca896ca-f9ca-4375-b0e1-237e8f41eea9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Acquiring lock "cinder-quobyte-3ca896ca-f9ca-4375-b0e1-237e8f41eea9" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Lock "cinder-quobyte-3ca896ca-f9ca-4375-b0e1-237e8f41eea9" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[190fe7de-1463-4077-a89e-120342652747]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:10 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9 Jul 15 18:43:10 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] Creating offline snapshot eb3e671a-9158-46b9-a0f9-6ba23954d2cd of volume 20765a6a-5c19-4b4b-bee9-f0f70316828c {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[89609050-20bb-4c79-ada6-3e50a0700513]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:10 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c Jul 15 18:43:10 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:10 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9" returned: 0 in 0.396s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:10 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9 Jul 15 18:43:10 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:10 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c" returned: 0 in 0.442s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:10 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd 1G Jul 15 18:43:10 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:10 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ca896ca-f9ca-4375-b0e1-237e8f41eea9" returned: 0 in 0.277s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Lock "cinder-quobyte-3ca896ca-f9ca-4375-b0e1-237e8f41eea9" released by "delete_volume" :: held 0.715s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Created reservations ['4b22e215-dabc-4fcb-aacd-b40293a74d99', '33abec29-c100-4c66-9d20-5bb733d46bb1', '45163aee-a269-49ee-a85b-ca68e745146e', '9c394f5f-d829-4e76-a308-8618ed27f5da'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:10 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:10 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:11 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd 1G" returned: 0 in 0.510s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20765a6a-5c19-4b4b-bee9-f0f70316828c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:11 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.303s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:11 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Deleted volume successfully. Jul 15 18:43:11 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20765a6a-5c19-4b4b-bee9-f0f70316828c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd Jul 15 18:43:11 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ab873311-a7fd-4514-8179-bb51c28a5d48 tempest-ProjectReaderTests-733186929 None] Lock "cinder-3ca896ca-f9ca-4375-b0e1-237e8f41eea9-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Flow 'volume_create_manager' (a4552a4d-cc17-439f-afff-df527ba87e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb2f77b-ef27-48bb-bc02-579f009bf812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb2f77b-ef27-48bb-bc02-579f009bf812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-921101474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa6796f-f653-4fd8-9ee1-05d211c60333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb8e6a5b38294b69ba77d73c6976ee26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:11Z,use_quota=True,user_id='cda632b635864406921e3914a27cc00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81670983-017b-44a6-ab36-4d5fdb90d0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81670983-017b-44a6-ab36-4d5fdb90d0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfe20ee-5580-4025-be09-130fb4045617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfe20ee-5580-4025-be09-130fb4045617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa6796f-f653-4fd8-9ee1-05d211c60333', 'volume_name': 'volume-faa6796f-f653-4fd8-9ee1-05d211c60333', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe0cf49-bdb9-4b5a-9e24-a64f30a4475b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe0cf49-bdb9-4b5a-9e24-a64f30a4475b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b80a222-e6b0-4b11-a2fe-f320288cdffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:11 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Volume faa6796f-f653-4fd8-9ee1-05d211c60333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa6796f-f653-4fd8-9ee1-05d211c60333', 'volume_size': 1} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:11 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20765a6a-5c19-4b4b-bee9-f0f70316828c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd" returned: 0 in 0.396s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:11 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd is being set with open permissions: ugo+rw Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:11 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd Jul 15 18:43:11 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:11 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Flow 'volume_create_manager' (88f3f2a9-21a5-47b4-b05f-08d1a609d29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cfe272-cb07-4a6c-bc85-325f9419c7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd" returned: 0 in 0.293s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cfe272-cb07-4a6c-bc85-325f9419c7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177423376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ef66f0-cd52-4048-80b5-4b947fa2d3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6516196535064780bdda193cc93482db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:12Z,use_quota=True,user_id='69b8e43404c242ce83ba48b3fe134c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d228e53-ef55-4cb4-951c-e72514c0efbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d228e53-ef55-4cb4-951c-e72514c0efbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e8920c-aa05-4e17-99fc-911cf0aece9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e8920c-aa05-4e17-99fc-911cf0aece9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ef66f0-cd52-4048-80b5-4b947fa2d3b2', 'volume_name': 'volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04f2bf2-163e-4d79-954c-b53b85754f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04f2bf2-163e-4d79-954c-b53b85754f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bd0338-1f4c-402a-8a84-1111401719a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:11 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Volume 30ef66f0-cd52-4048-80b5-4b947fa2d3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2', 'volume_size': 1} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:11 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.info Jul 15 18:43:11 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:12 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.info" returned: 0 in 0.245s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:12 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.info is being set with open permissions: ugo+rw Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:12 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.info Jul 15 18:43:12 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:12 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.info" returned: 0 in 0.262s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.942s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-921101474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa6796f-f653-4fd8-9ee1-05d211c60333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb8e6a5b38294b69ba77d73c6976ee26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:11Z,use_quota=True,user_id='cda632b635864406921e3914a27cc00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Creating volume faa6796f-f653-4fd8-9ee1-05d211c60333 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:12 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:12 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333 1073741824 Jul 15 18:43:12 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:12 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-bdc877d4-5918-4eb1-a8c1-84123a2eb338 tempest-VolumesDeleteCascade-388007155 None] Create snapshot completed successfully Jul 15 18:43:12 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333 1073741824" returned: 0 in 0.414s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:12 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333 Jul 15 18:43:12 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:13 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333" returned: 0 in 0.244s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.249s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177423376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ef66f0-cd52-4048-80b5-4b947fa2d3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6516196535064780bdda193cc93482db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:12Z,use_quota=True,user_id='69b8e43404c242ce83ba48b3fe134c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Creating volume 30ef66f0-cd52-4048-80b5-4b947fa2d3b2 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:13 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b80a222-e6b0-4b11-a2fe-f320288cdffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa6796f-f653-4fd8-9ee1-05d211c60333', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:13 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2 1073741824 Jul 15 18:43:13 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd59f3d-9b81-4bdd-b65f-3df88bcaa75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:13 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Volume volume-faa6796f-f653-4fd8-9ee1-05d211c60333 (faa6796f-f653-4fd8-9ee1-05d211c60333): created successfully Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd59f3d-9b81-4bdd-b65f-3df88bcaa75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Flow 'volume_create_manager' (a4552a4d-cc17-439f-afff-df527ba87e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:13 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-886221fd-c602-47ef-89df-641b0bf3c861 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Created volume successfully. Jul 15 18:43:13 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2 1073741824" returned: 0 in 0.517s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:13 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2 Jul 15 18:43:13 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:14 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Flow 'volume_create_manager' (630e0b60-16d3-4388-9cb8-e091214b35a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad21cdfe-2de5-428b-a341-75856f1f87f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2" returned: 0 in 0.374s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad21cdfe-2de5-428b-a341-75856f1f87f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-388721953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aab3a41-ee47-4128-b919-a9aaef051d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9d959cdecd4ead82f403f553612313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eb3e671a-9158-46b9-a0f9-6ba23954d2cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:14Z,use_quota=True,user_id='84c89cc73d8a45f09a3546fb8c2e1145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea94cb83-524c-4389-a9e1-3d0d12840765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea94cb83-524c-4389-a9e1-3d0d12840765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7092aff9-0b53-4ec8-9b15-130f4c8d178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7092aff9-0b53-4ec8-9b15-130f4c8d178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0aab3a41-ee47-4128-b919-a9aaef051d8a', 'volume_name': 'volume-0aab3a41-ee47-4128-b919-a9aaef051d8a', 'volume_size': 1, 'snapshot_id': 'eb3e671a-9158-46b9-a0f9-6ba23954d2cd'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a4b438-d14c-4881-86b7-af79b89137a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a4b438-d14c-4881-86b7-af79b89137a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1bdcd0-eb74-460a-ad9b-ffa99955a321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:14 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Volume 0aab3a41-ee47-4128-b919-a9aaef051d8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0aab3a41-ee47-4128-b919-a9aaef051d8a', 'volume_size': 1, 'snapshot_id': 'eb3e671a-9158-46b9-a0f9-6ba23954d2cd'} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bd0338-1f4c-402a-8a84-1111401719a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59de5df-6035-4fa1-91f2-066b50ac5ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-quobyte-eb3e671a-9158-46b9-a0f9-6ba23954d2cd-0aab3a41-ee47-4128-b919-a9aaef051d8a" by "_create_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:14 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Volume volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2 (30ef66f0-cd52-4048-80b5-4b947fa2d3b2): created successfully Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59de5df-6035-4fa1-91f2-066b50ac5ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Flow 'volume_create_manager' (88f3f2a9-21a5-47b4-b05f-08d1a609d29c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:14 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-853f6357-a656-4dd5-b3da-53a2de339612 tempest-ProjectReaderTests-733186929 None] Created volume successfully. Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-eb3e671a-9158-46b9-a0f9-6ba23954d2cd-0aab3a41-ee47-4128-b919-a9aaef051d8a" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Creating volume 0aab3a41-ee47-4128-b919-a9aaef051d8a from snapshot eb3e671a-9158-46b9-a0f9-6ba23954d2cd {{(pid=87217) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-quobyte-0aab3a41-ee47-4128-b919-a9aaef051d8a" by "_copy_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-0aab3a41-ee47-4128-b919-a9aaef051d8a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] snapshot: eb3e671a-9158-46b9-a0f9-6ba23954d2cd, volume: 0aab3a41-ee47-4128-b919-a9aaef051d8a, {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[083935e0-b4e9-4b4f-8d02-9ce719191982]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-0b847797-84fe-4048-8811-811d09bb0882 req-f6d5fd7e-63be-424b-8767-99e975b99173 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:14 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd Jul 15 18:43:14 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:14 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd" returned: 0 in 0.352s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20765a6a-5c19-4b4b-bee9-f0f70316828c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Creating direct copy from snapshot {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c332756-b34e-4a9f-825b-0578004d1b8e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:14 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c Jul 15 18:43:14 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Acquiring lock "cinder-30ef66f0-cd52-4048-80b5-4b947fa2d3b2-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Lock "cinder-30ef66f0-cd52-4048-80b5-4b947fa2d3b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Acquiring lock "cinder-quobyte-30ef66f0-cd52-4048-80b5-4b947fa2d3b2" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Lock "cinder-quobyte-30ef66f0-cd52-4048-80b5-4b947fa2d3b2" acquired by "delete_volume" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:15 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b79efb-2798-4add-91e0-355313728e3b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:15 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c" returned: 0 in 0.401s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:15 devstack cinder-volume[87217]: DEBUG cinder.utils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Path /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a not found in is_blk_device check {{(pid=87217) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:43:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:15 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a Jul 15 18:43:15 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:15 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2 Jul 15 18:43:15 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:15 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2" returned: 0 in 0.369s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:15 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2 Jul 15 18:43:15 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:15 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-30ef66f0-cd52-4048-80b5-4b947fa2d3b2" returned: 0 in 0.340s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Lock "cinder-quobyte-30ef66f0-cd52-4048-80b5-4b947fa2d3b2" released by "delete_volume" :: held 0.766s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:15 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Created reservations ['ecd17a2c-59cc-407a-997f-e675d5947aac', 'b4500ce3-12cc-43f1-b7e5-f820434aa633', '1621ca4a-3344-4e8b-a614-87aae02be136', 'fa9b3a1d-e0f8-4d7e-a7d9-4703f5ec97c5'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:16 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:16 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:16 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.541s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:16 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:16 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Deleted volume successfully. Jul 15 18:43:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ff114b85-5ebb-4785-9649-015933ab72a5 tempest-ProjectReaderTests-733186929 None] Lock "cinder-30ef66f0-cd52-4048-80b5-4b947fa2d3b2-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:19 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a" returned: 0 in 4.829s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:19 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[0600514d-448b-4dbd-953c-8fc8031a6e74]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:20 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c Jul 15 18:43:20 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:20 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c" returned: 0 in 0.533s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:43:20 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Converted 1024.00 MB image at 212.03 MB/s Jul 15 18:43:20 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a is being set with open permissions: ugo+rw Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:20 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a Jul 15 18:43:20 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:20 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a" returned: 0 in 0.249s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-0aab3a41-ee47-4128-b919-a9aaef051d8a" released by "_copy_volume_from_snapshot" :: held 6.489s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-eb3e671a-9158-46b9-a0f9-6ba23954d2cd-0aab3a41-ee47-4128-b919-a9aaef051d8a" released by "_create_volume_from_snapshot" :: held 6.525s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.560s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-0b847797-84fe-4048-8811-811d09bb0882 req-f6d5fd7e-63be-424b-8767-99e975b99173 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.417s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d75f69-ac4c-49d9-bf29-33f2348b5bcb]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-0b847797-84fe-4048-8811-811d09bb0882 req-f6d5fd7e-63be-424b-8767-99e975b99173 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1bdcd0-eb74-460a-ad9b-ffa99955a321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aab3a41-ee47-4128-b919-a9aaef051d8a', 'volume_size': 1, 'snapshot_id': 'eb3e671a-9158-46b9-a0f9-6ba23954d2cd'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732fef28-e084-499a-92c9-a4c5c8d89fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:20 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Volume volume-0aab3a41-ee47-4128-b919-a9aaef051d8a (0aab3a41-ee47-4128-b919-a9aaef051d8a): created successfully Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732fef28-e084-499a-92c9-a4c5c8d89fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Flow 'volume_create_manager' (630e0b60-16d3-4388-9cb8-e091214b35a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:20 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-448068fd-0da6-44ac-80a8-3ff126948b19 tempest-VolumesDeleteCascade-388007155 None] Created volume successfully. Jul 15 18:43:20 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333 Jul 15 18:43:20 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:21 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-0b847797-84fe-4048-8811-811d09bb0882 req-f6d5fd7e-63be-424b-8767-99e975b99173 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333" returned: 0 in 0.394s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-0b847797-84fe-4048-8811-811d09bb0882 req-f6d5fd7e-63be-424b-8767-99e975b99173 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.419s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0b847797-84fe-4048-8811-811d09bb0882 req-f6d5fd7e-63be-424b-8767-99e975b99173 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-faa6796f-f653-4fd8-9ee1-05d211c60333', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbbaa344-24e3-4d6d-ab0c-cc2ac939dcf0', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:43:21 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-0b847797-84fe-4048-8811-811d09bb0882 req-f6d5fd7e-63be-424b-8767-99e975b99173 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] attachment_update completed successfully. Jul 15 18:43:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-20765a6a-5c19-4b4b-bee9-f0f70316828c-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-20765a6a-5c19-4b4b-bee9-f0f70316828c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Performing cascade delete. {{(pid=87217) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-eb3e671a-9158-46b9-a0f9-6ba23954d2cd-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-eb3e671a-9158-46b9-a0f9-6ba23954d2cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-quobyte-20765a6a-5c19-4b4b-bee9-f0f70316828c" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-20765a6a-5c19-4b4b-bee9-f0f70316828c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-quobyte-eb3e671a-9158-46b9-a0f9-6ba23954d2cd" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-eb3e671a-9158-46b9-a0f9-6ba23954d2cd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Deleting offline snapshot eb3e671a-9158-46b9-a0f9-6ba23954d2cd of volume 20765a6a-5c19-4b4b-bee9-f0f70316828c {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] snapshot_file for this snap is: volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[9452d7dc-ff57-4c57-a8e4-f843747f264b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:22 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd Jul 15 18:43:22 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:22 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd" returned: 0 in 0.391s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20765a6a-5c19-4b4b-bee9-f0f70316828c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4963747c-6c16-4a21-a136-e5e0c9135171]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:22 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c Jul 15 18:43:22 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:23 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c" returned: 0 in 0.401s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:23 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd Jul 15 18:43:23 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:23 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd" returned: 0 in 0.381s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:23 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd Jul 15 18:43:23 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:23 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c.eb3e671a-9158-46b9-a0f9-6ba23954d2cd" returned: 0 in 0.291s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-eb3e671a-9158-46b9-a0f9-6ba23954d2cd" released by "_delete_snapshot" :: held 1.574s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-20765a6a-5c19-4b4b-bee9-f0f70316828c" released by "delete_snapshot" :: held 1.598s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Created reservations ['7aeac509-ac93-4334-8028-60a2dd63e437', '078a2bca-559d-43a1-a2f0-249d5f1199d6', '7467e914-c7b4-49fe-ae5e-3855485fa5f4', '615491b8-e9be-4ab1-836f-a7b24ff0b685'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:23 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Delete snapshot completed successfully. Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-eb3e671a-9158-46b9-a0f9-6ba23954d2cd-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Snapshots deleted, issuing volume delete {{(pid=87217) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-quobyte-20765a6a-5c19-4b4b-bee9-f0f70316828c" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-20765a6a-5c19-4b4b-bee9-f0f70316828c" acquired by "delete_volume" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e9d285-fbc9-4813-a4a0-4e05031ac9db]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:24 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c Jul 15 18:43:24 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c" returned: 0 in 0.416s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:24 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:24 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c Jul 15 18:43:24 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:24 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-20765a6a-5c19-4b4b-bee9-f0f70316828c" returned: 0 in 0.288s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-20765a6a-5c19-4b4b-bee9-f0f70316828c" released by "delete_volume" :: held 0.800s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:24 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Created reservations ['02037192-55c2-41f5-b71c-92c18f4da8f0', 'eb2e126e-ed46-4cba-94a4-cad5492b574d', '21a8d055-eaeb-4ada-a3a2-79cba5186f89', '05eea188-de76-47ae-bca4-b5983c32247d'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:24 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:24 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:25 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-c833d379-b591-449f-99eb-34f35b1f9399 req-1c6ce7be-887d-41f4-9c82-c6eb26e05eb5 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Terminate volume connection completed successfully. Jul 15 18:43:25 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-c833d379-b591-449f-99eb-34f35b1f9399 req-1c6ce7be-887d-41f4-9c82-c6eb26e05eb5 tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Deleting attachment dbbaa344-24e3-4d6d-ab0c-cc2ac939dcf0. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:43:25 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.325s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:25 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:25 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Deleted volume successfully. Jul 15 18:43:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a75a8d5b-cca7-4743-94a8-145e71da030b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-20765a6a-5c19-4b4b-bee9-f0f70316828c-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-0aab3a41-ee47-4128-b919-a9aaef051d8a-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-0aab3a41-ee47-4128-b919-a9aaef051d8a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "cinder-quobyte-0aab3a41-ee47-4128-b919-a9aaef051d8a" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-0aab3a41-ee47-4128-b919-a9aaef051d8a" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6806427-36af-49b6-8f87-a58af2225526]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:25 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a Jul 15 18:43:25 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Acquiring lock "cinder-faa6796f-f653-4fd8-9ee1-05d211c60333-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Lock "cinder-faa6796f-f653-4fd8-9ee1-05d211c60333-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:26 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a" returned: 0 in 0.440s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:26 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a Jul 15 18:43:26 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Acquiring lock "cinder-quobyte-faa6796f-f653-4fd8-9ee1-05d211c60333" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Lock "cinder-quobyte-faa6796f-f653-4fd8-9ee1-05d211c60333" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2e0d83-7040-488d-a337-befac03c343d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:26 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333 Jul 15 18:43:26 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:26 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0aab3a41-ee47-4128-b919-a9aaef051d8a" returned: 0 in 0.278s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-quobyte-0aab3a41-ee47-4128-b919-a9aaef051d8a" released by "delete_volume" :: held 0.761s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Created reservations ['b456fb4e-1f86-4333-a9e1-b60e61aa8ef1', '116f07d4-b207-47ef-9655-4fb444d09ba7', 'e45bf008-ae16-447e-aad9-6e6923daa0b5', '72d0321a-6d8c-4b8c-a8b0-6d57fd1d6fc4'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:26 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:26 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:26 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333" returned: 0 in 0.408s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:26 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333 Jul 15 18:43:26 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:26 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.328s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:26 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Deleted volume successfully. Jul 15 18:43:26 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2ea6dfe2-f12b-447d-b024-4f78472f9a0b tempest-VolumesDeleteCascade-388007155 None] Lock "cinder-0aab3a41-ee47-4128-b919-a9aaef051d8a-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-faa6796f-f653-4fd8-9ee1-05d211c60333" returned: 0 in 0.314s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Lock "cinder-quobyte-faa6796f-f653-4fd8-9ee1-05d211c60333" released by "delete_volume" :: held 0.765s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:26 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Created reservations ['1cf481bf-9ccf-43d9-a1e1-19c34bf195ad', '69a3f241-9ac5-4909-80be-0cde7d2ce56f', 'a6e0ba84-264d-4ecb-901d-7244f72fa855', 'bda9ee86-70ec-40e7-9011-e832b51fc9b2'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:27 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:27 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:27 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.332s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:27 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:27 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Deleted volume successfully. Jul 15 18:43:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6500badd-88b5-44e3-b6e7-8a7b2a379a1d tempest-TestServerVolumeAttachScenarioOldVersion-1349500501 None] Lock "cinder-faa6796f-f653-4fd8-9ee1-05d211c60333-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:INSERT=64,cinder:SELECT=149,cinder:UPDATE=197,cinder:DELETE=14 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=162,cinder:INSERT=50,cinder:DELETE=19,cinder:UPDATE=189 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Flow 'volume_create_manager' (2c031020-d425-4def-bfa1-e4eacb5ea1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edce4ae-4ef5-418b-9e48-e7ddf418ab97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edce4ae-4ef5-418b-9e48-e7ddf418ab97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-523128849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca75ccd1-405e-4626-9b1c-e3f27d403795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711be829e2a143cca38fee2463db7211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:28Z,use_quota=True,user_id='41045c6afd464602b9a93566ef092115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129b7c8f-f573-470c-bc16-a44bb8cbe590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129b7c8f-f573-470c-bc16-a44bb8cbe590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9affddc-27c7-48bd-b585-d7da35840608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9affddc-27c7-48bd-b585-d7da35840608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca75ccd1-405e-4626-9b1c-e3f27d403795', 'volume_name': 'volume-ca75ccd1-405e-4626-9b1c-e3f27d403795', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb26c8ed-06a0-49c0-9986-64e9a0f27d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb26c8ed-06a0-49c0-9986-64e9a0f27d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c91061-cf24-41fe-8272-2b79734c628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:28 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Volume ca75ccd1-405e-4626-9b1c-e3f27d403795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca75ccd1-405e-4626-9b1c-e3f27d403795', 'volume_size': 1} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-523128849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca75ccd1-405e-4626-9b1c-e3f27d403795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711be829e2a143cca38fee2463db7211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:28Z,use_quota=True,user_id='41045c6afd464602b9a93566ef092115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Creating volume ca75ccd1-405e-4626-9b1c-e3f27d403795 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:28 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:43:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ca75ccd1-405e-4626-9b1c-e3f27d403795 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:28 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ca75ccd1-405e-4626-9b1c-e3f27d403795 1073741824 Jul 15 18:43:28 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:29 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ca75ccd1-405e-4626-9b1c-e3f27d403795 1073741824" returned: 0 in 0.641s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ca75ccd1-405e-4626-9b1c-e3f27d403795 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:29 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ca75ccd1-405e-4626-9b1c-e3f27d403795 Jul 15 18:43:29 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:29 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ca75ccd1-405e-4626-9b1c-e3f27d403795" returned: 0 in 0.272s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c91061-cf24-41fe-8272-2b79734c628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca75ccd1-405e-4626-9b1c-e3f27d403795', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8ed667-8b93-4ab6-8a2f-97c4efaf3a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:29 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Volume volume-ca75ccd1-405e-4626-9b1c-e3f27d403795 (ca75ccd1-405e-4626-9b1c-e3f27d403795): created successfully Jul 15 18:43:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8ed667-8b93-4ab6-8a2f-97c4efaf3a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Flow 'volume_create_manager' (2c031020-d425-4def-bfa1-e4eacb5ea1ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:29 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a65280e3-fbd3-4b73-8fd2-5755c399c03f tempest-ProjectReaderTests-815782471 None] Created volume successfully. Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Flow 'volume_create_manager' (99531ff7-8665-4b46-b84c-fab99ef6c90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25433df-8a63-42f0-92ff-b1d88f834168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Acquiring lock "cinder-ca75ccd1-405e-4626-9b1c-e3f27d403795-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25433df-8a63-42f0-92ff-b1d88f834168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1869902750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93112b48-2075-4636-b09c-13e2245debd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25f5cd92542e41358a1ceb333021f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:31Z,use_quota=True,user_id='4c4add63be5e47f19de2344f98ce7b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d6f35c-7521-47e3-8080-d1436f856f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d6f35c-7521-47e3-8080-d1436f856f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088c94d9-8f9e-4728-899a-5ce101267a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088c94d9-8f9e-4728-899a-5ce101267a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93112b48-2075-4636-b09c-13e2245debd9', 'volume_name': 'volume-93112b48-2075-4636-b09c-13e2245debd9', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c3299d-31cb-427a-980a-d213fde130b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c3299d-31cb-427a-980a-d213fde130b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ff1f39-acd7-40c0-86a3-270edd74ddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:30 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Volume 93112b48-2075-4636-b09c-13e2245debd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93112b48-2075-4636-b09c-13e2245debd9', 'volume_size': 1} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1869902750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93112b48-2075-4636-b09c-13e2245debd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25f5cd92542e41358a1ceb333021f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:31Z,use_quota=True,user_id='4c4add63be5e47f19de2344f98ce7b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Creating volume 93112b48-2075-4636-b09c-13e2245debd9 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:30 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-93112b48-2075-4636-b09c-13e2245debd9 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Lock "cinder-ca75ccd1-405e-4626-9b1c-e3f27d403795-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:30 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-93112b48-2075-4636-b09c-13e2245debd9 1073741824 Jul 15 18:43:30 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Acquiring lock "cinder-quobyte-ca75ccd1-405e-4626-9b1c-e3f27d403795" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Lock "cinder-quobyte-ca75ccd1-405e-4626-9b1c-e3f27d403795" acquired by "delete_volume" :: waited 0.013s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fa6d45-7919-4ca8-bb51-95d2d9097c2f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ca75ccd1-405e-4626-9b1c-e3f27d403795 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:31 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ca75ccd1-405e-4626-9b1c-e3f27d403795 Jul 15 18:43:31 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:31 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-93112b48-2075-4636-b09c-13e2245debd9 1073741824" returned: 0 in 0.463s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-93112b48-2075-4636-b09c-13e2245debd9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:31 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-93112b48-2075-4636-b09c-13e2245debd9 Jul 15 18:43:31 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:31 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ca75ccd1-405e-4626-9b1c-e3f27d403795" returned: 0 in 0.414s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ca75ccd1-405e-4626-9b1c-e3f27d403795 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:31 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ca75ccd1-405e-4626-9b1c-e3f27d403795 Jul 15 18:43:31 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:31 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-93112b48-2075-4636-b09c-13e2245debd9" returned: 0 in 0.270s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ff1f39-acd7-40c0-86a3-270edd74ddc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93112b48-2075-4636-b09c-13e2245debd9', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f763cb-6bc3-49e1-9c49-70dcd3492848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:31 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Volume volume-93112b48-2075-4636-b09c-13e2245debd9 (93112b48-2075-4636-b09c-13e2245debd9): created successfully Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f763cb-6bc3-49e1-9c49-70dcd3492848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:31 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Flow 'volume_create_manager' (99531ff7-8665-4b46-b84c-fab99ef6c90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ca75ccd1-405e-4626-9b1c-e3f27d403795" returned: 0 in 0.284s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Lock "cinder-quobyte-ca75ccd1-405e-4626-9b1c-e3f27d403795" released by "delete_volume" :: held 0.751s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:31 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-21e9d654-ab41-4f5c-aac6-5649b05d7073 tempest-VolumesListTestJSON-334047313 None] Created volume successfully. Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Created reservations ['3e2e3bb2-60c2-413f-b4ac-dea39b2570a1', '2abafe1b-71d4-48ee-8d58-23c7d7838ac7', 'e6966b3b-7b70-4cac-a6ad-80bf320cfc59', 'c39c0558-a295-4fc1-84a3-a7373fcc0e24'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:31 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:31 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:32 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.275s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:32 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Deleted volume successfully. Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fafa07a3-9a96-4f2a-a8c1-f26aefded7a7 tempest-ProjectReaderTests-815782471 None] Lock "cinder-ca75ccd1-405e-4626-9b1c-e3f27d403795-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Flow 'volume_create_manager' (6862e347-9784-4b3e-9a98-842285325fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88959b6e-ec24-411b-a3da-685c0d15a8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88959b6e-ec24-411b-a3da-685c0d15a8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895713178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afdaec24-2cf5-4854-b7ca-93eee355188d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711be829e2a143cca38fee2463db7211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:32Z,use_quota=True,user_id='41045c6afd464602b9a93566ef092115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e960ec87-6043-4694-b6b4-213d90fedb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e960ec87-6043-4694-b6b4-213d90fedb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692df394-2460-4bd8-a14c-ea83fced608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692df394-2460-4bd8-a14c-ea83fced608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afdaec24-2cf5-4854-b7ca-93eee355188d', 'volume_name': 'volume-afdaec24-2cf5-4854-b7ca-93eee355188d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69deddf8-776b-4951-901a-94532aff09d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69deddf8-776b-4951-901a-94532aff09d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d54f16e-6978-4df6-992d-45d2481ceeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:32 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Volume afdaec24-2cf5-4854-b7ca-93eee355188d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afdaec24-2cf5-4854-b7ca-93eee355188d', 'volume_size': 1} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895713178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afdaec24-2cf5-4854-b7ca-93eee355188d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711be829e2a143cca38fee2463db7211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:32Z,use_quota=True,user_id='41045c6afd464602b9a93566ef092115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Creating volume afdaec24-2cf5-4854-b7ca-93eee355188d {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:32 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-afdaec24-2cf5-4854-b7ca-93eee355188d 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:32 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-afdaec24-2cf5-4854-b7ca-93eee355188d 1073741824 Jul 15 18:43:32 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:32 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:32 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:33 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.312s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:43:33 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-afdaec24-2cf5-4854-b7ca-93eee355188d 1073741824" returned: 0 in 0.585s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-afdaec24-2cf5-4854-b7ca-93eee355188d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:33 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-afdaec24-2cf5-4854-b7ca-93eee355188d Jul 15 18:43:33 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Flow 'volume_create_manager' (8822564f-3d81-497b-9219-2c9f3433f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d166673-90ae-4adf-8767-1267f5da6bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d166673-90ae-4adf-8767-1267f5da6bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-676318760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdf5d34-a804-4afa-8f33-ec46e268afde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25f5cd92542e41358a1ceb333021f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:33Z,use_quota=True,user_id='4c4add63be5e47f19de2344f98ce7b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5dfbf4c-9858-409c-95ba-82934d331c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5dfbf4c-9858-409c-95ba-82934d331c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696f4013-4497-44b9-96d2-63d85a7dcf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696f4013-4497-44b9-96d2-63d85a7dcf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cdf5d34-a804-4afa-8f33-ec46e268afde', 'volume_name': 'volume-7cdf5d34-a804-4afa-8f33-ec46e268afde', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd624946-5de7-45da-8f78-4a1b7de3a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd624946-5de7-45da-8f78-4a1b7de3a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c9c1e6-e1a6-49d9-893e-cdb29d669323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:33 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Volume 7cdf5d34-a804-4afa-8f33-ec46e268afde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cdf5d34-a804-4afa-8f33-ec46e268afde', 'volume_size': 1} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:33 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-afdaec24-2cf5-4854-b7ca-93eee355188d" returned: 0 in 0.297s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-676318760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdf5d34-a804-4afa-8f33-ec46e268afde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25f5cd92542e41358a1ceb333021f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:33Z,use_quota=True,user_id='4c4add63be5e47f19de2344f98ce7b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Creating volume 7cdf5d34-a804-4afa-8f33-ec46e268afde {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:33 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7cdf5d34-a804-4afa-8f33-ec46e268afde 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d54f16e-6978-4df6-992d-45d2481ceeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afdaec24-2cf5-4854-b7ca-93eee355188d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:33 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7cdf5d34-a804-4afa-8f33-ec46e268afde 1073741824 Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d152ebc-3679-49f7-bec5-c9fd7400885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:33 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:33 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Volume volume-afdaec24-2cf5-4854-b7ca-93eee355188d (afdaec24-2cf5-4854-b7ca-93eee355188d): created successfully Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d152ebc-3679-49f7-bec5-c9fd7400885c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Flow 'volume_create_manager' (6862e347-9784-4b3e-9a98-842285325fa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:33 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b09b8d70-34f6-4535-b39a-bc7a4a30d238 tempest-ProjectReaderTests-815782471 None] Created volume successfully. Jul 15 18:43:33 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7cdf5d34-a804-4afa-8f33-ec46e268afde 1073741824" returned: 0 in 0.468s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7cdf5d34-a804-4afa-8f33-ec46e268afde {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:33 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7cdf5d34-a804-4afa-8f33-ec46e268afde Jul 15 18:43:33 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:34 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7cdf5d34-a804-4afa-8f33-ec46e268afde" returned: 0 in 0.266s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c9c1e6-e1a6-49d9-893e-cdb29d669323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cdf5d34-a804-4afa-8f33-ec46e268afde', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10dc5c9d-8e5d-4a07-b68a-59246d0431be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:34 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Volume volume-7cdf5d34-a804-4afa-8f33-ec46e268afde (7cdf5d34-a804-4afa-8f33-ec46e268afde): created successfully Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10dc5c9d-8e5d-4a07-b68a-59246d0431be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Flow 'volume_create_manager' (8822564f-3d81-497b-9219-2c9f3433f873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:34 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-00339494-b490-44a6-8d62-defc8d1ba422 tempest-VolumesListTestJSON-334047313 None] Created volume successfully. Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Acquiring lock "cinder-afdaec24-2cf5-4854-b7ca-93eee355188d-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Lock "cinder-afdaec24-2cf5-4854-b7ca-93eee355188d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Acquiring lock "cinder-quobyte-afdaec24-2cf5-4854-b7ca-93eee355188d" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Lock "cinder-quobyte-afdaec24-2cf5-4854-b7ca-93eee355188d" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4212dc94-0b08-4f5d-88f8-c71aca450627]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-afdaec24-2cf5-4854-b7ca-93eee355188d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:34 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-afdaec24-2cf5-4854-b7ca-93eee355188d Jul 15 18:43:34 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:35 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-afdaec24-2cf5-4854-b7ca-93eee355188d" returned: 0 in 0.412s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-afdaec24-2cf5-4854-b7ca-93eee355188d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:35 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-afdaec24-2cf5-4854-b7ca-93eee355188d Jul 15 18:43:35 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:35 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-afdaec24-2cf5-4854-b7ca-93eee355188d" returned: 0 in 0.318s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Lock "cinder-quobyte-afdaec24-2cf5-4854-b7ca-93eee355188d" released by "delete_volume" :: held 0.784s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Created reservations ['5db3c319-3523-4761-982b-ed3bd2d7cc6b', '934a267b-c8c2-4675-be2b-f3171b7c03d7', '2d64adae-6a2d-4076-b9a0-4664d1d55618', '7819ceb1-2fda-452c-b897-8d4e97967ea6'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:35 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:35 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:35 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.299s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:35 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Deleted volume successfully. Jul 15 18:43:35 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e3476f55-2814-4ae1-9049-6a095d72592d tempest-ProjectReaderTests-815782471 None] Lock "cinder-afdaec24-2cf5-4854-b7ca-93eee355188d-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Flow 'volume_create_manager' (3527bfc6-0ce7-4303-9205-9643d9e6fe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7c4f9d-d972-4ad3-9b2f-8da39bec387f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7c4f9d-d972-4ad3-9b2f-8da39bec387f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1569303460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f92c15c-9dad-43cf-9df0-a97628f0a266,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25f5cd92542e41358a1ceb333021f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:36Z,use_quota=True,user_id='4c4add63be5e47f19de2344f98ce7b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b918f5b6-6dcb-4ab6-95d0-c45aabdfce1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b918f5b6-6dcb-4ab6-95d0-c45aabdfce1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96732502-d8db-49ec-9e48-c0dae80aae60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96732502-d8db-49ec-9e48-c0dae80aae60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f92c15c-9dad-43cf-9df0-a97628f0a266', 'volume_name': 'volume-2f92c15c-9dad-43cf-9df0-a97628f0a266', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0766691c-b44e-4763-8257-5cc4a23bd5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0766691c-b44e-4763-8257-5cc4a23bd5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5e0d10-cbd4-48e0-b04d-d875b316a343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:36 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Volume 2f92c15c-9dad-43cf-9df0-a97628f0a266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f92c15c-9dad-43cf-9df0-a97628f0a266', 'volume_size': 1} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1569303460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f92c15c-9dad-43cf-9df0-a97628f0a266,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25f5cd92542e41358a1ceb333021f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:36Z,use_quota=True,user_id='4c4add63be5e47f19de2344f98ce7b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Creating volume 2f92c15c-9dad-43cf-9df0-a97628f0a266 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:36 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2f92c15c-9dad-43cf-9df0-a97628f0a266 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:36 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2f92c15c-9dad-43cf-9df0-a97628f0a266 1073741824 Jul 15 18:43:36 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Flow 'volume_create_manager' (1c03ea9d-8caf-487d-b58a-9dbb7ed28d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d058eb8-ed81-4330-bfc8-ef08b0813e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d058eb8-ed81-4330-bfc8-ef08b0813e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1748255666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab699761-f28f-41c9-bffb-98306be4a33d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711be829e2a143cca38fee2463db7211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:36Z,use_quota=True,user_id='41045c6afd464602b9a93566ef092115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f887b40-c3f7-483c-bdd8-294c3dbb85d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f887b40-c3f7-483c-bdd8-294c3dbb85d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c65200b-a31e-480e-a8d2-90fab642bf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c65200b-a31e-480e-a8d2-90fab642bf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab699761-f28f-41c9-bffb-98306be4a33d', 'volume_name': 'volume-ab699761-f28f-41c9-bffb-98306be4a33d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2844386e-7263-46aa-8ca4-4857357cd669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2844386e-7263-46aa-8ca4-4857357cd669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646a42d4-b197-411b-bef3-16b96eb4aaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:36 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Volume ab699761-f28f-41c9-bffb-98306be4a33d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab699761-f28f-41c9-bffb-98306be4a33d', 'volume_size': 1} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:36 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2f92c15c-9dad-43cf-9df0-a97628f0a266 1073741824" returned: 0 in 0.500s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2f92c15c-9dad-43cf-9df0-a97628f0a266 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:36 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2f92c15c-9dad-43cf-9df0-a97628f0a266 Jul 15 18:43:36 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:37 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2f92c15c-9dad-43cf-9df0-a97628f0a266" returned: 0 in 0.276s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1748255666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab699761-f28f-41c9-bffb-98306be4a33d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711be829e2a143cca38fee2463db7211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:36Z,use_quota=True,user_id='41045c6afd464602b9a93566ef092115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Creating volume ab699761-f28f-41c9-bffb-98306be4a33d {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:37 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ab699761-f28f-41c9-bffb-98306be4a33d 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5e0d10-cbd4-48e0-b04d-d875b316a343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f92c15c-9dad-43cf-9df0-a97628f0a266', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:37 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ab699761-f28f-41c9-bffb-98306be4a33d 1073741824 Jul 15 18:43:37 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25af302c-461b-43bc-bf45-a34529b5ebff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:37 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Volume volume-2f92c15c-9dad-43cf-9df0-a97628f0a266 (2f92c15c-9dad-43cf-9df0-a97628f0a266): created successfully Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25af302c-461b-43bc-bf45-a34529b5ebff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Flow 'volume_create_manager' (3527bfc6-0ce7-4303-9205-9643d9e6fe63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-84382a9e-f1a7-425d-ac8d-c62261430900 tempest-VolumesListTestJSON-334047313 None] Created volume successfully. Jul 15 18:43:37 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ab699761-f28f-41c9-bffb-98306be4a33d 1073741824" returned: 0 in 0.443s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ab699761-f28f-41c9-bffb-98306be4a33d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:37 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ab699761-f28f-41c9-bffb-98306be4a33d Jul 15 18:43:37 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:37 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ab699761-f28f-41c9-bffb-98306be4a33d" returned: 0 in 0.275s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646a42d4-b197-411b-bef3-16b96eb4aaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab699761-f28f-41c9-bffb-98306be4a33d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc0b3c1-7043-42b6-92df-7636753684ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:37 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Volume volume-ab699761-f28f-41c9-bffb-98306be4a33d (ab699761-f28f-41c9-bffb-98306be4a33d): created successfully Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc0b3c1-7043-42b6-92df-7636753684ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Flow 'volume_create_manager' (1c03ea9d-8caf-487d-b58a-9dbb7ed28d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b9411f32-cc6c-4daf-85b8-e7f4474d19ec tempest-ProjectReaderTests-815782471 None] Created volume successfully. Jul 15 18:43:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Acquiring lock "cinder-ab699761-f28f-41c9-bffb-98306be4a33d-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Lock "cinder-ab699761-f28f-41c9-bffb-98306be4a33d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Acquiring lock "cinder-quobyte-ab699761-f28f-41c9-bffb-98306be4a33d" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Lock "cinder-quobyte-ab699761-f28f-41c9-bffb-98306be4a33d" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:38 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b28ef2-9b79-4b7c-a661-509fcef734ef]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ab699761-f28f-41c9-bffb-98306be4a33d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:38 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ab699761-f28f-41c9-bffb-98306be4a33d Jul 15 18:43:38 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:39 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ab699761-f28f-41c9-bffb-98306be4a33d" returned: 0 in 0.453s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ab699761-f28f-41c9-bffb-98306be4a33d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:39 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ab699761-f28f-41c9-bffb-98306be4a33d Jul 15 18:43:39 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:39 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ab699761-f28f-41c9-bffb-98306be4a33d" returned: 0 in 0.394s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Lock "cinder-quobyte-ab699761-f28f-41c9-bffb-98306be4a33d" released by "delete_volume" :: held 0.902s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:39 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Created reservations ['18f342f4-ad15-4e44-be15-ae42c61bd3d6', '3768cf20-5f0f-41bd-a5c8-dd9e948b8516', 'fe898aa0-5b32-4d51-a1a6-52bc6d33d0d6', '055c3a1e-caf9-4442-953f-da3d4e8ddcf9'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:39 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:39 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:40 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.295s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:40 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Deleted volume successfully. Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-cf70206d-3c92-4463-9ad4-5cbb8b3ea33f tempest-ProjectReaderTests-815782471 None] Lock "cinder-ab699761-f28f-41c9-bffb-98306be4a33d-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Flow 'volume_create_manager' (391f2230-a13b-4588-964f-2c367bf506dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d543e2b2-e768-4546-a6d9-b482c874a2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d543e2b2-e768-4546-a6d9-b482c874a2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2059285162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9674db-6e03-405a-93f0-0c809de67425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711be829e2a143cca38fee2463db7211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:40Z,use_quota=True,user_id='41045c6afd464602b9a93566ef092115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f58fcb6-be81-47b7-8bbd-4783cbb1f9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f58fcb6-be81-47b7-8bbd-4783cbb1f9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d94b830-0605-42f7-a84e-d6458886d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d94b830-0605-42f7-a84e-d6458886d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a9674db-6e03-405a-93f0-0c809de67425', 'volume_name': 'volume-2a9674db-6e03-405a-93f0-0c809de67425', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9751966-ec47-4dd6-808e-a319ca9a2fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9751966-ec47-4dd6-808e-a319ca9a2fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a9bd89-6048-4221-a2fe-b7ab46a4d211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:40 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Volume 2a9674db-6e03-405a-93f0-0c809de67425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a9674db-6e03-405a-93f0-0c809de67425', 'volume_size': 1} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2059285162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9674db-6e03-405a-93f0-0c809de67425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711be829e2a143cca38fee2463db7211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:40Z,use_quota=True,user_id='41045c6afd464602b9a93566ef092115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Creating volume 2a9674db-6e03-405a-93f0-0c809de67425 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:40 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2a9674db-6e03-405a-93f0-0c809de67425 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:40 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2a9674db-6e03-405a-93f0-0c809de67425 1073741824 Jul 15 18:43:40 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Acquiring lock "cinder-2f92c15c-9dad-43cf-9df0-a97628f0a266-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Lock "cinder-2f92c15c-9dad-43cf-9df0-a97628f0a266-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Acquiring lock "cinder-quobyte-2f92c15c-9dad-43cf-9df0-a97628f0a266" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Lock "cinder-quobyte-2f92c15c-9dad-43cf-9df0-a97628f0a266" acquired by "delete_volume" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd2e4ea-ab07-497a-a1a1-b790efb76b27]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2f92c15c-9dad-43cf-9df0-a97628f0a266 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:40 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2f92c15c-9dad-43cf-9df0-a97628f0a266 Jul 15 18:43:40 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:41 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2a9674db-6e03-405a-93f0-0c809de67425 1073741824" returned: 0 in 0.484s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2a9674db-6e03-405a-93f0-0c809de67425 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:41 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2a9674db-6e03-405a-93f0-0c809de67425 Jul 15 18:43:41 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:41 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2f92c15c-9dad-43cf-9df0-a97628f0a266" returned: 0 in 0.410s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2f92c15c-9dad-43cf-9df0-a97628f0a266 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:41 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2f92c15c-9dad-43cf-9df0-a97628f0a266 Jul 15 18:43:41 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:41 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2a9674db-6e03-405a-93f0-0c809de67425" returned: 0 in 0.302s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a9bd89-6048-4221-a2fe-b7ab46a4d211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a9674db-6e03-405a-93f0-0c809de67425', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7792ba56-4585-4e62-a3f3-389bd91e1935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:41 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Volume volume-2a9674db-6e03-405a-93f0-0c809de67425 (2a9674db-6e03-405a-93f0-0c809de67425): created successfully Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7792ba56-4585-4e62-a3f3-389bd91e1935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Flow 'volume_create_manager' (391f2230-a13b-4588-964f-2c367bf506dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:41 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1dd5ae66-8585-4b90-b7cb-fb2ff3361a1e tempest-ProjectReaderTests-815782471 None] Created volume successfully. Jul 15 18:43:41 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2f92c15c-9dad-43cf-9df0-a97628f0a266" returned: 0 in 0.329s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Lock "cinder-quobyte-2f92c15c-9dad-43cf-9df0-a97628f0a266" released by "delete_volume" :: held 0.787s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Created reservations ['3398e256-35ba-4e3f-96de-3dc2effa5d68', '1edd40c4-6065-4fbd-8699-53b6ac0a117c', 'ecf98259-d809-4073-95ba-f15a3d7e803f', '93f8b5c3-ee84-44b5-ab41-a1761ce751d2'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:41 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:41 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Acquiring lock "cinder-7cdf5d34-a804-4afa-8f33-ec46e268afde-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:41 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.280s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Lock "cinder-7cdf5d34-a804-4afa-8f33-ec46e268afde-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:42 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Deleted volume successfully. Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5d49251-ead7-4911-800d-fee5de15d06e tempest-VolumesListTestJSON-334047313 None] Lock "cinder-2f92c15c-9dad-43cf-9df0-a97628f0a266-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Acquiring lock "cinder-quobyte-7cdf5d34-a804-4afa-8f33-ec46e268afde" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Lock "cinder-quobyte-7cdf5d34-a804-4afa-8f33-ec46e268afde" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0ddc48-d396-4060-a272-1079c4655c40]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7cdf5d34-a804-4afa-8f33-ec46e268afde {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:42 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7cdf5d34-a804-4afa-8f33-ec46e268afde Jul 15 18:43:42 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:42 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7cdf5d34-a804-4afa-8f33-ec46e268afde" returned: 0 in 0.434s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7cdf5d34-a804-4afa-8f33-ec46e268afde {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:42 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7cdf5d34-a804-4afa-8f33-ec46e268afde Jul 15 18:43:42 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Acquiring lock "cinder-2a9674db-6e03-405a-93f0-0c809de67425-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Lock "cinder-2a9674db-6e03-405a-93f0-0c809de67425-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Acquiring lock "cinder-quobyte-2a9674db-6e03-405a-93f0-0c809de67425" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Lock "cinder-quobyte-2a9674db-6e03-405a-93f0-0c809de67425" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c035e2e-e5d8-4499-9339-2b3555a3f01e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2a9674db-6e03-405a-93f0-0c809de67425 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:42 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7cdf5d34-a804-4afa-8f33-ec46e268afde" returned: 0 in 0.345s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:42 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2a9674db-6e03-405a-93f0-0c809de67425 Jul 15 18:43:42 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Lock "cinder-quobyte-7cdf5d34-a804-4afa-8f33-ec46e268afde" released by "delete_volume" :: held 0.824s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:42 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Created reservations ['f4246419-4cb9-42ba-9d22-fd34e4ff01be', '69e7e547-6cc1-4a9b-8c53-f021c5c1903e', 'd035bcd9-9401-421a-892d-77a040119193', '2020215e-fee8-4907-9bc5-a81f53582e1d'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:43 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:43 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:43 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2a9674db-6e03-405a-93f0-0c809de67425" returned: 0 in 0.498s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2a9674db-6e03-405a-93f0-0c809de67425 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:43 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2a9674db-6e03-405a-93f0-0c809de67425 Jul 15 18:43:43 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Acquiring lock "cinder-93112b48-2075-4636-b09c-13e2245debd9-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Lock "cinder-93112b48-2075-4636-b09c-13e2245debd9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Acquiring lock "cinder-quobyte-93112b48-2075-4636-b09c-13e2245debd9" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Lock "cinder-quobyte-93112b48-2075-4636-b09c-13e2245debd9" acquired by "delete_volume" :: waited 0.029s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5c1edf-bb31-4f78-9867-5d0a3cc83688]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-93112b48-2075-4636-b09c-13e2245debd9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:43 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.347s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:43 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Deleted volume successfully. Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9468d2a7-3ec1-46de-bad0-e1d67402d983 tempest-VolumesListTestJSON-334047313 None] Lock "cinder-7cdf5d34-a804-4afa-8f33-ec46e268afde-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:43 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-93112b48-2075-4636-b09c-13e2245debd9 Jul 15 18:43:43 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:43 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2a9674db-6e03-405a-93f0-0c809de67425" returned: 0 in 0.331s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Lock "cinder-quobyte-2a9674db-6e03-405a-93f0-0c809de67425" released by "delete_volume" :: held 0.899s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Created reservations ['5a34b528-0bb2-4d54-b4d2-634dfa682b1a', '4d0e804f-0a6c-47f2-9f97-777156c680bd', 'aab85efd-e91b-42be-b646-d8d53d9d1242', '4cdef90e-bbf1-4992-b619-49df1d95fd7c'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:43 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:43 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:43 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-93112b48-2075-4636-b09c-13e2245debd9" returned: 0 in 0.454s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-93112b48-2075-4636-b09c-13e2245debd9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:43 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-93112b48-2075-4636-b09c-13e2245debd9 Jul 15 18:43:43 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:44 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.295s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:44 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Deleted volume successfully. Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-98222f44-be67-47a5-92b5-df9228a752af tempest-ProjectReaderTests-815782471 None] Lock "cinder-2a9674db-6e03-405a-93f0-0c809de67425-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:44 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-93112b48-2075-4636-b09c-13e2245debd9" returned: 0 in 0.318s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Lock "cinder-quobyte-93112b48-2075-4636-b09c-13e2245debd9" released by "delete_volume" :: held 0.827s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Created reservations ['62d28ec6-5ce6-4d39-a5ad-b155ad59ca29', '0b0b8cd9-6d71-4a75-b7c2-b647294dff52', '1c35332d-b1a3-4b7d-b24d-4e112548199d', 'e26e3dbe-5bb9-4094-a875-b2e0388c62bb'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:44 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:43:44 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:44 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.307s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:43:44 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Deleted volume successfully. Jul 15 18:43:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a9b08ca2-dfba-4dc0-9595-e4d6a2866a20 tempest-VolumesListTestJSON-334047313 None] Lock "cinder-93112b48-2075-4636-b09c-13e2245debd9-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:43:54 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=50,cinder:UPDATE=69,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:43:54 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=47,cinder:UPDATE=84,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Flow 'volume_create_manager' (2de530e1-7d82-4d54-afad-896a49436099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82126dc7-9788-442b-beb3-c24e32f9b2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82126dc7-9788-442b-beb3-c24e32f9b2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1180874965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec69405-e9b7-4ca8-ae63-53b564af723c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8620bc641af4962b486c8195d83ca70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:58Z,use_quota=True,user_id='fb1e9bef8a0e48609bb23620770d4f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2801cde-f76f-4560-a2af-a2ba89b80317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2801cde-f76f-4560-a2af-a2ba89b80317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909d4157-61d4-47a0-b287-da554d47bd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909d4157-61d4-47a0-b287-da554d47bd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec69405-e9b7-4ca8-ae63-53b564af723c', 'volume_name': 'volume-bec69405-e9b7-4ca8-ae63-53b564af723c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9042c1eb-0709-4996-ba0f-499fd4edd333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9042c1eb-0709-4996-ba0f-499fd4edd333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9070e4-9e79-4102-a09e-5140d06b85ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:57 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Volume bec69405-e9b7-4ca8-ae63-53b564af723c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec69405-e9b7-4ca8-ae63-53b564af723c', 'volume_size': 1} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1180874965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec69405-e9b7-4ca8-ae63-53b564af723c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8620bc641af4962b486c8195d83ca70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:43:58Z,use_quota=True,user_id='fb1e9bef8a0e48609bb23620770d4f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Creating volume bec69405-e9b7-4ca8-ae63-53b564af723c {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:43:57 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:43:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:58 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c 1073741824 Jul 15 18:43:58 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:58 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c 1073741824" returned: 0 in 0.460s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:43:58 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c Jul 15 18:43:58 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:43:58 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Jul 15 18:43:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c" returned: 0 in 0.250s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:43:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:43:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:43:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9070e4-9e79-4102-a09e-5140d06b85ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec69405-e9b7-4ca8-ae63-53b564af723c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05edd1cd-9657-4f5a-95d8-6001382ec156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:43:58 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Volume volume-bec69405-e9b7-4ca8-ae63-53b564af723c (bec69405-e9b7-4ca8-ae63-53b564af723c): created successfully Jul 15 18:43:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05edd1cd-9657-4f5a-95d8-6001382ec156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:43:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Flow 'volume_create_manager' (2de530e1-7d82-4d54-afad-896a49436099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:43:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-3103469e-024f-4457-80e0-6c90bf9612fe tempest-VolumesSnapshotTestJSON-657456899 None] Created volume successfully. Jul 15 18:44:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] Creating offline snapshot 71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 of volume bec69405-e9b7-4ca8-ae63-53b564af723c {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:44:00 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e425b79d-86d0-46ce-a532-e1660c462a34]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:00 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c Jul 15 18:44:00 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:00 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c" returned: 0 in 0.407s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:00 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 1G Jul 15 18:44:00 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:01 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 1G" returned: 0 in 0.410s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bec69405-e9b7-4ca8-ae63-53b564af723c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:01 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bec69405-e9b7-4ca8-ae63-53b564af723c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 Jul 15 18:44:01 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:01 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bec69405-e9b7-4ca8-ae63-53b564af723c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4" returned: 0 in 0.285s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:01 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 is being set with open permissions: ugo+rw Jul 15 18:44:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:01 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 Jul 15 18:44:01 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:01 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4" returned: 0 in 0.368s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:01 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.info Jul 15 18:44:01 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:02 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.info" returned: 0 in 0.285s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:02 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.info is being set with open permissions: ugo+rw Jul 15 18:44:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:02 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.info Jul 15 18:44:02 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:02 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.info" returned: 0 in 0.272s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:02 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ea3c9844-84af-48e2-9591-2b2efbfc186f tempest-VolumesSnapshotTestJSON-657456899 None] Create snapshot completed successfully Jul 15 18:44:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-71f64d11-8538-4874-a1d6-e2e9d0e5ffc4-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-71f64d11-8538-4874-a1d6-e2e9d0e5ffc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-bec69405-e9b7-4ca8-ae63-53b564af723c" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-bec69405-e9b7-4ca8-ae63-53b564af723c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-71f64d11-8538-4874-a1d6-e2e9d0e5ffc4" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-71f64d11-8538-4874-a1d6-e2e9d0e5ffc4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Deleting offline snapshot 71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 of volume bec69405-e9b7-4ca8-ae63-53b564af723c {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:44:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] snapshot_file for this snap is: volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:44:03 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5360b08-fa06-4c4d-bc0a-c8a0c1197bff]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:03 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 Jul 15 18:44:03 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:04 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4" returned: 0 in 0.419s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:04 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bec69405-e9b7-4ca8-ae63-53b564af723c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:44:04 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb02847-14d2-4b82-b8c4-2eb27aedbbda]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:04 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c Jul 15 18:44:04 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:04 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c" returned: 0 in 0.402s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:04 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 Jul 15 18:44:04 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:04 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4" returned: 0 in 0.428s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:05 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4 Jul 15 18:44:05 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:05 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c.71f64d11-8538-4874-a1d6-e2e9d0e5ffc4" returned: 0 in 0.276s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-71f64d11-8538-4874-a1d6-e2e9d0e5ffc4" released by "_delete_snapshot" :: held 1.665s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-bec69405-e9b7-4ca8-ae63-53b564af723c" released by "delete_snapshot" :: held 1.697s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:05 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Created reservations ['97604623-4eed-4deb-b8f5-db59bd9c7d8c', 'c2e085aa-3006-43d0-9264-2eb9e859d55e', 'a644a25d-346f-49e9-a121-aeb2d977824c', '2c10cd98-184b-44ab-8962-0d9e7fff72d8'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:05 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Delete snapshot completed successfully. Jul 15 18:44:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d81afc8d-b93e-4410-b22f-828d93146047 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-71f64d11-8538-4874-a1d6-e2e9d0e5ffc4-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:05 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:44:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Flow 'volume_create_manager' (fbd86770-708a-4ff5-8ce9-5a056cf48fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9345781f-c4fc-4a72-87f4-7ea63e423edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9345781f-c4fc-4a72-87f4-7ea63e423edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-679266219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43faa78e-2b8e-4cdd-a825-47f9ddfd406e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3959239a3b467091252af0b6e37475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:06Z,use_quota=True,user_id='56275fbe7333472dba48ec58f7321a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:05 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040b8863-5217-4406-a9bf-fa7502d6202c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040b8863-5217-4406-a9bf-fa7502d6202c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9df9165-d832-48e7-9296-5038411edce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9df9165-d832-48e7-9296-5038411edce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43faa78e-2b8e-4cdd-a825-47f9ddfd406e', 'volume_name': 'volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949e210c-7d2c-44d5-bc99-a191e1f6bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949e210c-7d2c-44d5-bc99-a191e1f6bde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9c3d53-7031-4983-b093-426806f522f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Volume 43faa78e-2b8e-4cdd-a825-47f9ddfd406e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e', 'volume_size': 1} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-679266219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43faa78e-2b8e-4cdd-a825-47f9ddfd406e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3959239a3b467091252af0b6e37475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:06Z,use_quota=True,user_id='56275fbe7333472dba48ec58f7321a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Creating volume 43faa78e-2b8e-4cdd-a825-47f9ddfd406e {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:44:06 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:06 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e 1073741824 Jul 15 18:44:06 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:06 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e 1073741824" returned: 0 in 0.536s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:06 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e Jul 15 18:44:06 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Flow 'volume_create_manager' (50793f4b-e63f-4210-a527-90b73ef731c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac8ad2b-7c83-4b52-b354-abbce96dc9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac8ad2b-7c83-4b52-b354-abbce96dc9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-571570338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe92c9d9-7ac2-4601-9575-370313a39483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3959239a3b467091252af0b6e37475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:07Z,use_quota=True,user_id='56275fbe7333472dba48ec58f7321a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e988dc63-eae2-4415-9356-7087437a190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e988dc63-eae2-4415-9356-7087437a190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c42fcd-e8c1-42ee-b53c-08fcb2ab023d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c42fcd-e8c1-42ee-b53c-08fcb2ab023d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe92c9d9-7ac2-4601-9575-370313a39483', 'volume_name': 'volume-fe92c9d9-7ac2-4601-9575-370313a39483', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a920225f-3eff-4243-86c4-522a82a3bb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a920225f-3eff-4243-86c4-522a82a3bb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854f3a9a-e87c-495c-bef4-e50b2f7e0a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Volume fe92c9d9-7ac2-4601-9575-370313a39483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe92c9d9-7ac2-4601-9575-370313a39483', 'volume_size': 1} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Flow 'volume_create_manager' (6025de11-6309-46f1-b96c-368c0fa77b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5eaef6-a921-4de7-ae03-4fd028188a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5eaef6-a921-4de7-ae03-4fd028188a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1709922405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1acf29b-b788-4a4c-8bb1-b178de570a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8620bc641af4962b486c8195d83ca70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:07Z,use_quota=True,user_id='fb1e9bef8a0e48609bb23620770d4f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18347c59-3427-4522-81a0-55611c7fc4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18347c59-3427-4522-81a0-55611c7fc4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21a6cb6-3964-4cb0-987b-bf6409e05d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21a6cb6-3964-4cb0-987b-bf6409e05d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1acf29b-b788-4a4c-8bb1-b178de570a95', 'volume_name': 'volume-f1acf29b-b788-4a4c-8bb1-b178de570a95', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a71a4b2-5542-4dc0-8e28-89ddfdd3432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a71a4b2-5542-4dc0-8e28-89ddfdd3432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6d2a56-c010-464f-a52b-b3f7e8db94ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Volume f1acf29b-b788-4a4c-8bb1-b178de570a95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1acf29b-b788-4a4c-8bb1-b178de570a95', 'volume_size': 1} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e" returned: 0 in 0.288s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.090s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-571570338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe92c9d9-7ac2-4601-9575-370313a39483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3959239a3b467091252af0b6e37475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:07Z,use_quota=True,user_id='56275fbe7333472dba48ec58f7321a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Creating volume fe92c9d9-7ac2-4601-9575-370313a39483 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:44:06 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9c3d53-7031-4983-b093-426806f522f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483 1073741824 Jul 15 18:44:06 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68590b0-a89a-4ff0-9d7b-fd116f1c38c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:06 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Volume volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e (43faa78e-2b8e-4cdd-a825-47f9ddfd406e): created successfully Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68590b0-a89a-4ff0-9d7b-fd116f1c38c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Flow 'volume_create_manager' (fbd86770-708a-4ff5-8ce9-5a056cf48fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:07 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-34999f03-39ff-47ef-8159-533d26fa3499 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Created volume successfully. Jul 15 18:44:07 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483 1073741824" returned: 0 in 0.478s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:07 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483 Jul 15 18:44:07 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:07 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483" returned: 0 in 0.256s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.792s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1709922405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1acf29b-b788-4a4c-8bb1-b178de570a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8620bc641af4962b486c8195d83ca70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:07Z,use_quota=True,user_id='fb1e9bef8a0e48609bb23620770d4f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Creating volume f1acf29b-b788-4a4c-8bb1-b178de570a95 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:44:07 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:07 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 1073741824 Jul 15 18:44:07 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854f3a9a-e87c-495c-bef4-e50b2f7e0a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe92c9d9-7ac2-4601-9575-370313a39483', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97dbe8f8-f388-4592-a132-1afa6e195945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:07 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Volume volume-fe92c9d9-7ac2-4601-9575-370313a39483 (fe92c9d9-7ac2-4601-9575-370313a39483): created successfully Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97dbe8f8-f388-4592-a132-1afa6e195945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Flow 'volume_create_manager' (50793f4b-e63f-4210-a527-90b73ef731c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:07 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d379802e-2f75-48d6-a6e5-17a97a001b22 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Created volume successfully. Jul 15 18:44:08 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 1073741824" returned: 0 in 0.469s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:08 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 Jul 15 18:44:08 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:08 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95" returned: 0 in 0.253s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:44:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6d2a56-c010-464f-a52b-b3f7e8db94ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1acf29b-b788-4a4c-8bb1-b178de570a95', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a20d48-949b-4926-b0b7-483ac9ee3745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:08 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Volume volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 (f1acf29b-b788-4a4c-8bb1-b178de570a95): created successfully Jul 15 18:44:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a20d48-949b-4926-b0b7-483ac9ee3745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Flow 'volume_create_manager' (6025de11-6309-46f1-b96c-368c0fa77b7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:08 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e9e08919-904a-415d-8f08-3bd65bc567b2 tempest-VolumesSnapshotTestJSON-657456899 None] Created volume successfully. Jul 15 18:44:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] Creating offline snapshot 9498bab4-d717-4d08-8292-6eda85c4ce7e of volume f1acf29b-b788-4a4c-8bb1-b178de570a95 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:44:09 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e29bea-276f-42d6-9627-249d72776043]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:09 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 Jul 15 18:44:09 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:10 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95" returned: 0 in 0.428s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:10 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e 1G Jul 15 18:44:10 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:10 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e 1G" returned: 0 in 0.482s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:10 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e Jul 15 18:44:10 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:11 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e" returned: 0 in 0.398s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:11 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e is being set with open permissions: ugo+rw Jul 15 18:44:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:11 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e Jul 15 18:44:11 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:11 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e" returned: 0 in 0.277s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:11 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.info Jul 15 18:44:11 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:11 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.info" returned: 0 in 0.264s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:11 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.info is being set with open permissions: ugo+rw Jul 15 18:44:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:11 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.info Jul 15 18:44:11 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:11 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.info" returned: 0 in 0.272s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.228s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:11 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-513f2bfd-111e-4d37-8bfe-155bf546a13e tempest-VolumesSnapshotTestJSON-657456899 None] Create snapshot completed successfully Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Flow 'volume_create_manager' (bc8bf06f-3e1a-4341-a0d5-df8977337aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e787413-d989-4657-bb17-dbc35349bbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e787413-d989-4657-bb17-dbc35349bbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-238284382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544cd725-031d-49f1-bab9-5f6f9a3660e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8620bc641af4962b486c8195d83ca70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9498bab4-d717-4d08-8292-6eda85c4ce7e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:14Z,use_quota=True,user_id='fb1e9bef8a0e48609bb23620770d4f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088fac04-e277-4a22-a354-285d0fbac18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088fac04-e277-4a22-a354-285d0fbac18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0735e5-4c80-4746-9bad-1ec400ab5897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0735e5-4c80-4746-9bad-1ec400ab5897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '544cd725-031d-49f1-bab9-5f6f9a3660e9', 'volume_name': 'volume-544cd725-031d-49f1-bab9-5f6f9a3660e9', 'volume_size': 2, 'snapshot_id': '9498bab4-d717-4d08-8292-6eda85c4ce7e'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ce1a18-104e-4243-bff4-3b078a06d44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ce1a18-104e-4243-bff4-3b078a06d44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a80f07d-01b1-4f9c-82b2-cbc6ed4f5192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:13 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Volume 544cd725-031d-49f1-bab9-5f6f9a3660e9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-544cd725-031d-49f1-bab9-5f6f9a3660e9', 'volume_size': 2, 'snapshot_id': '9498bab4-d717-4d08-8292-6eda85c4ce7e'} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-9498bab4-d717-4d08-8292-6eda85c4ce7e-544cd725-031d-49f1-bab9-5f6f9a3660e9" by "_create_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-9498bab4-d717-4d08-8292-6eda85c4ce7e-544cd725-031d-49f1-bab9-5f6f9a3660e9" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Creating volume 544cd725-031d-49f1-bab9-5f6f9a3660e9 from snapshot 9498bab4-d717-4d08-8292-6eda85c4ce7e {{(pid=87217) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-544cd725-031d-49f1-bab9-5f6f9a3660e9" by "_copy_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-544cd725-031d-49f1-bab9-5f6f9a3660e9" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] snapshot: 9498bab4-d717-4d08-8292-6eda85c4ce7e, volume: 544cd725-031d-49f1-bab9-5f6f9a3660e9, {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[730b6729-6184-400c-a3c2-79775f98de51]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:14 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e Jul 15 18:44:14 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:14 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e" returned: 0 in 0.458s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1acf29b-b788-4a4c-8bb1-b178de570a95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:44:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:44:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Creating direct copy from snapshot {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:44:14 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feeaa18-3ec6-43ed-adc2-a8a2276084aa]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:14 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 Jul 15 18:44:14 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:14 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95" returned: 0 in 0.401s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:14 devstack cinder-volume[87217]: DEBUG cinder.utils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Path /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9 not found in is_blk_device check {{(pid=87217) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:44:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:14 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9 Jul 15 18:44:14 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:20 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9" returned: 0 in 5.820s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:20 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a875213a-5917-4786-b643-0d69c940a4ee]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:20 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 Jul 15 18:44:20 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:21 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95" returned: 0 in 0.545s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9 {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:44:21 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Converted 1024.00 MB image at 175.91 MB/s Jul 15 18:44:21 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9 is being set with open permissions: ugo+rw Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:21 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9 Jul 15 18:44:21 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:21 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9" returned: 0 in 0.240s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-544cd725-031d-49f1-bab9-5f6f9a3660e9" released by "_copy_volume_from_snapshot" :: held 7.574s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-9498bab4-d717-4d08-8292-6eda85c4ce7e-544cd725-031d-49f1-bab9-5f6f9a3660e9" released by "_create_volume_from_snapshot" :: held 7.606s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.621s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a80f07d-01b1-4f9c-82b2-cbc6ed4f5192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544cd725-031d-49f1-bab9-5f6f9a3660e9', 'volume_size': 2, 'snapshot_id': '9498bab4-d717-4d08-8292-6eda85c4ce7e'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbb12c4-7cab-41be-b1b8-2f3c097caf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:21 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Volume volume-544cd725-031d-49f1-bab9-5f6f9a3660e9 (544cd725-031d-49f1-bab9-5f6f9a3660e9): created successfully Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbb12c4-7cab-41be-b1b8-2f3c097caf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Flow 'volume_create_manager' (bc8bf06f-3e1a-4341-a0d5-df8977337aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:21 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-506f077e-327d-4be0-8f65-6497b055b098 tempest-VolumesSnapshotTestJSON-657456899 None] Created volume successfully. Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-544cd725-031d-49f1-bab9-5f6f9a3660e9-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-544cd725-031d-49f1-bab9-5f6f9a3660e9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-544cd725-031d-49f1-bab9-5f6f9a3660e9" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-544cd725-031d-49f1-bab9-5f6f9a3660e9" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a563c3-18fa-4352-a955-4d7d97231efe]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:22 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9 Jul 15 18:44:22 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:22 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9" returned: 0 in 0.357s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:22 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9 Jul 15 18:44:22 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:22 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-544cd725-031d-49f1-bab9-5f6f9a3660e9" returned: 0 in 0.241s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-544cd725-031d-49f1-bab9-5f6f9a3660e9" released by "delete_volume" :: held 0.638s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Created reservations ['e250d75c-3668-430c-8cde-6712c1d5ccd1', '184c82f4-4a34-4a7e-9165-b88448c5c946', '20d2e46c-e73f-4d5c-b4b3-ddba8f2e7b97', '1323ecda-528c-472e-b929-f1c683e4de7b'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:22 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:44:22 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:22 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.236s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:22 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Deleted volume successfully. Jul 15 18:44:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-959c0ac7-e091-4629-ba04-384e47591b30 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-544cd725-031d-49f1-bab9-5f6f9a3660e9-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-9498bab4-d717-4d08-8292-6eda85c4ce7e-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-9498bab4-d717-4d08-8292-6eda85c4ce7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-f1acf29b-b788-4a4c-8bb1-b178de570a95" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-f1acf29b-b788-4a4c-8bb1-b178de570a95" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-9498bab4-d717-4d08-8292-6eda85c4ce7e" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-9498bab4-d717-4d08-8292-6eda85c4ce7e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Deleting offline snapshot 9498bab4-d717-4d08-8292-6eda85c4ce7e of volume f1acf29b-b788-4a4c-8bb1-b178de570a95 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] snapshot_file for this snap is: volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[45863c51-9573-4a72-8bf1-2a5a98285bd1]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:23 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e Jul 15 18:44:23 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:23 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e" returned: 0 in 0.356s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1acf29b-b788-4a4c-8bb1-b178de570a95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb0413a-57cc-4f5f-a26e-12d3b18a5b31]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:23 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 Jul 15 18:44:23 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:23 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95" returned: 0 in 0.379s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:23 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e Jul 15 18:44:23 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:24 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e" returned: 0 in 0.340s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:24 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e Jul 15 18:44:24 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:24 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95.9498bab4-d717-4d08-8292-6eda85c4ce7e" returned: 0 in 0.246s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-9498bab4-d717-4d08-8292-6eda85c4ce7e" released by "_delete_snapshot" :: held 1.408s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-f1acf29b-b788-4a4c-8bb1-b178de570a95" released by "delete_snapshot" :: held 1.432s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:24 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Created reservations ['668b8610-4fca-4301-ba1c-b8421b5d53c0', '70af89da-772c-4754-8eda-b4b9d1ebea64', '6b9de723-8bbe-47b2-9dcd-f1c8373ca786', '221aeab8-5de0-487d-ac8e-ca0c5176e68e'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:24 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Delete snapshot completed successfully. Jul 15 18:44:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6cf08811-db04-4b99-b798-6e1a2b27524e tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-9498bab4-d717-4d08-8292-6eda85c4ce7e-delete_snapshot" released by "delete_snapshot" :: held 1.586s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-f1acf29b-b788-4a4c-8bb1-b178de570a95-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-f1acf29b-b788-4a4c-8bb1-b178de570a95-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-f1acf29b-b788-4a4c-8bb1-b178de570a95" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-f1acf29b-b788-4a4c-8bb1-b178de570a95" acquired by "delete_volume" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b1ae0e-c917-4120-983f-1e4c92128294]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:25 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 Jul 15 18:44:25 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:25 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95" returned: 0 in 0.367s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:25 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95 Jul 15 18:44:25 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:26 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f1acf29b-b788-4a4c-8bb1-b178de570a95" returned: 0 in 0.245s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-f1acf29b-b788-4a4c-8bb1-b178de570a95" released by "delete_volume" :: held 0.674s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:26 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Created reservations ['bf7f182b-cebd-48b1-81ae-e20366147f74', '5bfa63d5-9008-4bb7-9b7f-6675f94b0e23', '7f902cc2-4041-4700-a817-218b3abf726f', '87916b35-f83b-44cf-9a79-674813c6b4de'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:26 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:44:26 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:26 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.302s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:26 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:26 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Deleted volume successfully. Jul 15 18:44:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7bea6529-9b6f-4f65-a8c3-c6b24dce41c1 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-f1acf29b-b788-4a4c-8bb1-b178de570a95-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Flow 'volume_create_manager' (256c76c7-c761-4680-a5bd-a55d6e6e25ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b03a5c9-1933-43a6-a716-19e89c0ceebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b03a5c9-1933-43a6-a716-19e89c0ceebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2091693367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34412ba3-8077-4e1e-aa94-a6702954e9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8620bc641af4962b486c8195d83ca70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:27Z,use_quota=True,user_id='fb1e9bef8a0e48609bb23620770d4f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c017a6f0-7cc4-445a-919d-7fd6fbca466b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c017a6f0-7cc4-445a-919d-7fd6fbca466b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1666ff4d-9bb6-41f9-8237-0ae69f2457b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1666ff4d-9bb6-41f9-8237-0ae69f2457b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34412ba3-8077-4e1e-aa94-a6702954e9ac', 'volume_name': 'volume-34412ba3-8077-4e1e-aa94-a6702954e9ac', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a343fbb5-a19e-4238-9f14-1ad6fbd408f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a343fbb5-a19e-4238-9f14-1ad6fbd408f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9008b1-9038-45b4-a26f-dd15041d8756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:27 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Volume 34412ba3-8077-4e1e-aa94-a6702954e9ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34412ba3-8077-4e1e-aa94-a6702954e9ac', 'volume_size': 1} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2091693367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34412ba3-8077-4e1e-aa94-a6702954e9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8620bc641af4962b486c8195d83ca70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:27Z,use_quota=True,user_id='fb1e9bef8a0e48609bb23620770d4f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Creating volume 34412ba3-8077-4e1e-aa94-a6702954e9ac {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:44:27 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:27 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac 1073741824 Jul 15 18:44:27 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:27 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac 1073741824" returned: 0 in 0.403s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:27 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac Jul 15 18:44:27 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:27 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac" returned: 0 in 0.235s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9008b1-9038-45b4-a26f-dd15041d8756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34412ba3-8077-4e1e-aa94-a6702954e9ac', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e07e1b1-785e-4f6f-822d-8e0e907c710a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:27 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Volume volume-34412ba3-8077-4e1e-aa94-a6702954e9ac (34412ba3-8077-4e1e-aa94-a6702954e9ac): created successfully Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e07e1b1-785e-4f6f-822d-8e0e907c710a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Flow 'volume_create_manager' (256c76c7-c761-4680-a5bd-a55d6e6e25ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:27 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-07ddeee9-4146-4935-993b-e1ddd8eabdec tempest-VolumesSnapshotTestJSON-657456899 None] Created volume successfully. Jul 15 18:44:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] Creating offline snapshot ddead23e-16b9-4f2a-b81e-92de534e361e of volume 34412ba3-8077-4e1e-aa94-a6702954e9ac {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:44:28 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[792648ce-78ed-421c-8344-480bf9810e7c]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:28 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac Jul 15 18:44:28 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:28 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac" returned: 0 in 0.361s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:28 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e 1G Jul 15 18:44:28 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:28 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e 1G" returned: 0 in 0.392s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34412ba3-8077-4e1e-aa94-a6702954e9ac -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:28 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34412ba3-8077-4e1e-aa94-a6702954e9ac -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e Jul 15 18:44:28 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:29 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34412ba3-8077-4e1e-aa94-a6702954e9ac -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e" returned: 0 in 0.285s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:29 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e is being set with open permissions: ugo+rw Jul 15 18:44:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:29 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e Jul 15 18:44:29 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:29 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e" returned: 0 in 0.235s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:29 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.info Jul 15 18:44:29 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:29 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.info" returned: 0 in 0.247s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:29 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.info is being set with open permissions: ugo+rw Jul 15 18:44:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:29 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.info Jul 15 18:44:29 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:30 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.info" returned: 0 in 0.235s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a7249c20-d888-4660-9a76-605bb5f1f71c tempest-VolumesSnapshotTestJSON-657456899 None] Create snapshot completed successfully Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Flow 'volume_create_manager' (b59c7f93-ed50-4332-bd87-b3cba91252e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a7294b-ab84-4f36-9e74-d2c96b4093d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a7294b-ab84-4f36-9e74-d2c96b4093d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1583629352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d8dd54-275a-4273-aab7-705654f07439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8620bc641af4962b486c8195d83ca70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ddead23e-16b9-4f2a-b81e-92de534e361e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:44:31Z,use_quota=True,user_id='fb1e9bef8a0e48609bb23620770d4f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e5a355-df0e-4cda-a90a-4d15c41ff0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e5a355-df0e-4cda-a90a-4d15c41ff0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe012ab-2a6a-4eca-af41-fd336e12eb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe012ab-2a6a-4eca-af41-fd336e12eb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd9d8dd54-275a-4273-aab7-705654f07439', 'volume_name': 'volume-d9d8dd54-275a-4273-aab7-705654f07439', 'volume_size': 1, 'snapshot_id': 'ddead23e-16b9-4f2a-b81e-92de534e361e'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2228708-0367-49e8-b17d-17e149547f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2228708-0367-49e8-b17d-17e149547f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b796a9e6-b9d7-4a86-a60d-cdc422dac4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:30 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Volume d9d8dd54-275a-4273-aab7-705654f07439: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d9d8dd54-275a-4273-aab7-705654f07439', 'volume_size': 1, 'snapshot_id': 'ddead23e-16b9-4f2a-b81e-92de534e361e'} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-ddead23e-16b9-4f2a-b81e-92de534e361e-d9d8dd54-275a-4273-aab7-705654f07439" by "_create_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-ddead23e-16b9-4f2a-b81e-92de534e361e-d9d8dd54-275a-4273-aab7-705654f07439" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Creating volume d9d8dd54-275a-4273-aab7-705654f07439 from snapshot ddead23e-16b9-4f2a-b81e-92de534e361e {{(pid=87217) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-d9d8dd54-275a-4273-aab7-705654f07439" by "_copy_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-d9d8dd54-275a-4273-aab7-705654f07439" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] snapshot: ddead23e-16b9-4f2a-b81e-92de534e361e, volume: d9d8dd54-275a-4273-aab7-705654f07439, {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee802621-fd49-4df8-894d-a2531c298c10]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:31 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e Jul 15 18:44:31 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:31 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e" returned: 0 in 0.375s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34412ba3-8077-4e1e-aa94-a6702954e9ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:44:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:44:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Creating direct copy from snapshot {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:44:31 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[9741a081-19e5-4996-b67f-10dbb1c38891]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:31 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac Jul 15 18:44:31 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:31 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac" returned: 0 in 0.369s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:31 devstack cinder-volume[87217]: DEBUG cinder.utils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Path /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439 not found in is_blk_device check {{(pid=87217) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:44:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:31 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439 Jul 15 18:44:31 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:44:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:32 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:44:32 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:33 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.444s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:44:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:44:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:44:36 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439" returned: 0 in 4.677s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc15b89-d544-4004-b778-618bf545c063]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:36 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac Jul 15 18:44:36 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:36 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac" returned: 0 in 0.527s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:36 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439 {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:44:36 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Converted 1024.00 MB image at 218.91 MB/s Jul 15 18:44:36 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439 is being set with open permissions: ugo+rw Jul 15 18:44:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:36 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439 Jul 15 18:44:36 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:37 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439" returned: 0 in 0.242s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-d9d8dd54-275a-4273-aab7-705654f07439" released by "_copy_volume_from_snapshot" :: held 6.273s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-ddead23e-16b9-4f2a-b81e-92de534e361e-d9d8dd54-275a-4273-aab7-705654f07439" released by "_create_volume_from_snapshot" :: held 6.300s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.315s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b796a9e6-b9d7-4a86-a60d-cdc422dac4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d8dd54-275a-4273-aab7-705654f07439', 'volume_size': 1, 'snapshot_id': 'ddead23e-16b9-4f2a-b81e-92de534e361e'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b50f585-6cf5-48dd-b80a-9d87fe8bba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:44:37 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Volume volume-d9d8dd54-275a-4273-aab7-705654f07439 (d9d8dd54-275a-4273-aab7-705654f07439): created successfully Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b50f585-6cf5-48dd-b80a-9d87fe8bba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Flow 'volume_create_manager' (b59c7f93-ed50-4332-bd87-b3cba91252e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:44:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-baa79cea-1f11-43c1-bebd-ed0652f890e7 tempest-VolumesSnapshotTestJSON-657456899 None] Created volume successfully. Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-d9d8dd54-275a-4273-aab7-705654f07439-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-d9d8dd54-275a-4273-aab7-705654f07439-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-d9d8dd54-275a-4273-aab7-705654f07439" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-d9d8dd54-275a-4273-aab7-705654f07439" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6d53a5-2c50-4e89-b49a-bb058045a99f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:37 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439 Jul 15 18:44:37 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:38 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439" returned: 0 in 0.354s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:38 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439 Jul 15 18:44:38 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:38 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d9d8dd54-275a-4273-aab7-705654f07439" returned: 0 in 0.241s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-d9d8dd54-275a-4273-aab7-705654f07439" released by "delete_volume" :: held 0.631s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Created reservations ['952a4b01-0d1d-4a64-b5a8-723b1d0f2c44', '514676c0-82ab-46ed-8431-3d7d8e04cc57', '89321dbe-704a-4802-a90a-fe13f7d35fde', '6dc437bc-3e42-490c-b71f-3e934ff7c067'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:38 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:44:38 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:38 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.258s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:38 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Deleted volume successfully. Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b88ef727-8d4b-4554-afc8-68d33d2aac08 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-d9d8dd54-275a-4273-aab7-705654f07439-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-ddead23e-16b9-4f2a-b81e-92de534e361e-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-ddead23e-16b9-4f2a-b81e-92de534e361e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-34412ba3-8077-4e1e-aa94-a6702954e9ac" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-34412ba3-8077-4e1e-aa94-a6702954e9ac" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-ddead23e-16b9-4f2a-b81e-92de534e361e" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-ddead23e-16b9-4f2a-b81e-92de534e361e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Deleting offline snapshot ddead23e-16b9-4f2a-b81e-92de534e361e of volume 34412ba3-8077-4e1e-aa94-a6702954e9ac {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] snapshot_file for this snap is: volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a1c8d5-1650-4ad5-8164-dbef1ccf5f02]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:38 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e Jul 15 18:44:38 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:39 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e" returned: 0 in 0.346s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34412ba3-8077-4e1e-aa94-a6702954e9ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:44:39 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a02956-0951-480f-ae7c-0add8cf32f3d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:39 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac Jul 15 18:44:39 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:39 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac" returned: 0 in 0.364s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:39 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e Jul 15 18:44:39 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:39 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e" returned: 0 in 0.332s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:39 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e Jul 15 18:44:39 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:40 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac.ddead23e-16b9-4f2a-b81e-92de534e361e" returned: 0 in 0.238s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-ddead23e-16b9-4f2a-b81e-92de534e361e" released by "_delete_snapshot" :: held 1.374s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-34412ba3-8077-4e1e-aa94-a6702954e9ac" released by "delete_snapshot" :: held 1.393s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:40 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Created reservations ['07c823f7-f960-43a1-b342-ce2c0f270ac7', '895b0992-7f22-45e6-be66-2ec81599a7b4', '39d0f167-165f-44c2-9724-a19c2dfd2c26', '43052858-5245-4323-a614-83800d57ac5c'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:40 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Delete snapshot completed successfully. Jul 15 18:44:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d002d14-0cb6-4797-a74e-fe92c133c063 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-ddead23e-16b9-4f2a-b81e-92de534e361e-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-34412ba3-8077-4e1e-aa94-a6702954e9ac-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-34412ba3-8077-4e1e-aa94-a6702954e9ac-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-34412ba3-8077-4e1e-aa94-a6702954e9ac" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-34412ba3-8077-4e1e-aa94-a6702954e9ac" acquired by "delete_volume" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:41 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ba45fd-fd31-4bee-b85d-f61060249785]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:41 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac Jul 15 18:44:41 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:41 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac" returned: 0 in 0.423s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:41 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac Jul 15 18:44:41 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:41 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-34412ba3-8077-4e1e-aa94-a6702954e9ac" returned: 0 in 0.351s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-34412ba3-8077-4e1e-aa94-a6702954e9ac" released by "delete_volume" :: held 0.844s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Created reservations ['bc771635-da24-4eb2-af4d-1bf5d071e9fc', 'd2a20586-72a7-42a9-bb6c-e2aca04a7c87', 'a8a9de62-a134-40c7-b4c8-9b84a57d8332', 'ed6ac4b1-33a2-4c0b-8f84-480a74f0fae9'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-0e9b3a0f-7aab-4cbb-abeb-076d5e284dd9 req-57483c35-0693-4459-85d8-e7666263d4e0 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-0e9b3a0f-7aab-4cbb-abeb-076d5e284dd9 req-57483c35-0693-4459-85d8-e7666263d4e0 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae3467b-21f0-44b1-ba77-8de369ef6a8c]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-0e9b3a0f-7aab-4cbb-abeb-076d5e284dd9 req-57483c35-0693-4459-85d8-e7666263d4e0 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:42 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:44:42 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:42 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e Jul 15 18:44:42 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-bec69405-e9b7-4ca8-ae63-53b564af723c-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-bec69405-e9b7-4ca8-ae63-53b564af723c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "cinder-quobyte-bec69405-e9b7-4ca8-ae63-53b564af723c" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-bec69405-e9b7-4ca8-ae63-53b564af723c" acquired by "delete_volume" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6d47e0-8a9b-494c-9247-dccd198a9f14]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:42 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.309s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:42 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Deleted volume successfully. Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c2f37558-2e1c-4b66-83a5-8e0400cc4159 tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-34412ba3-8077-4e1e-aa94-a6702954e9ac-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:42 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-0e9b3a0f-7aab-4cbb-abeb-076d5e284dd9 req-57483c35-0693-4459-85d8-e7666263d4e0 tempest-TestServerVolumeAttachmentScenario-1741018821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e" returned: 0 in 0.452s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-0e9b3a0f-7aab-4cbb-abeb-076d5e284dd9 req-57483c35-0693-4459-85d8-e7666263d4e0 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.476s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-0e9b3a0f-7aab-4cbb-abeb-076d5e284dd9 req-57483c35-0693-4459-85d8-e7666263d4e0 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aff9759a-fb7f-423b-8ff2-d907cd9d972b', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:44:42 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c Jul 15 18:44:42 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:42 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-0e9b3a0f-7aab-4cbb-abeb-076d5e284dd9 req-57483c35-0693-4459-85d8-e7666263d4e0 tempest-TestServerVolumeAttachmentScenario-1741018821 None] attachment_update completed successfully. Jul 15 18:44:42 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c" returned: 0 in 0.458s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:42 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c Jul 15 18:44:42 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:43 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-bec69405-e9b7-4ca8-ae63-53b564af723c" returned: 0 in 0.330s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-quobyte-bec69405-e9b7-4ca8-ae63-53b564af723c" released by "delete_volume" :: held 0.861s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:43 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Created reservations ['2fe810b8-a4e2-448a-a7c2-db419777ab8f', '7334ea30-0e21-4a8d-ad09-ea036b44d214', '0218456d-ff74-48fa-841d-625c718667d0', 'eccea9fd-b01e-417b-8d15-dbc90ee6052e'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:43 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:44:43 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:43 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.265s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:43 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:43 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Deleted volume successfully. Jul 15 18:44:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e66c0b4a-594d-4031-bacb-5ec86320319c tempest-VolumesSnapshotTestJSON-657456899 None] Lock "cinder-bec69405-e9b7-4ca8-ae63-53b564af723c-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-39629537-4afa-4fa8-a87c-17e90be2fc05 req-17f91b2b-71d1-4ec1-8377-92a4b62cd832 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-39629537-4afa-4fa8-a87c-17e90be2fc05 req-17f91b2b-71d1-4ec1-8377-92a4b62cd832 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:46 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d77ee-bdbd-4320-80ad-e6fc1277e8da]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-39629537-4afa-4fa8-a87c-17e90be2fc05 req-17f91b2b-71d1-4ec1-8377-92a4b62cd832 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:46 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483 Jul 15 18:44:46 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:47 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-39629537-4afa-4fa8-a87c-17e90be2fc05 req-17f91b2b-71d1-4ec1-8377-92a4b62cd832 tempest-TestServerVolumeAttachmentScenario-1741018821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483" returned: 0 in 0.399s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-39629537-4afa-4fa8-a87c-17e90be2fc05 req-17f91b2b-71d1-4ec1-8377-92a4b62cd832 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.420s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:47 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-39629537-4afa-4fa8-a87c-17e90be2fc05 req-17f91b2b-71d1-4ec1-8377-92a4b62cd832 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-fe92c9d9-7ac2-4601-9575-370313a39483', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e100254-f066-4b33-9192-84e5d6fa8524', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:44:47 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-39629537-4afa-4fa8-a87c-17e90be2fc05 req-17f91b2b-71d1-4ec1-8377-92a4b62cd832 tempest-TestServerVolumeAttachmentScenario-1741018821 None] attachment_update completed successfully. Jul 15 18:44:49 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-e93568a6-92f2-4a98-a9ac-e41e342b062e req-b7f95cd7-189d-400a-b13c-3bb40eab45d1 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Terminate volume connection completed successfully. Jul 15 18:44:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-e93568a6-92f2-4a98-a9ac-e41e342b062e req-b7f95cd7-189d-400a-b13c-3bb40eab45d1 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Deleting attachment 2e100254-f066-4b33-9192-84e5d6fa8524. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:44:51 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-9dab87fc-f9cc-489c-a874-3e344a24c148 req-4926dd4c-a6b3-45e2-9310-45b79f97005d tempest-TestServerVolumeAttachmentScenario-1741018821 None] Terminate volume connection completed successfully. Jul 15 18:44:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-9dab87fc-f9cc-489c-a874-3e344a24c148 req-4926dd4c-a6b3-45e2-9310-45b79f97005d tempest-TestServerVolumeAttachmentScenario-1741018821 None] Deleting attachment aff9759a-fb7f-423b-8ff2-d907cd9d972b. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:44:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Acquiring lock "cinder-fe92c9d9-7ac2-4601-9575-370313a39483-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "cinder-fe92c9d9-7ac2-4601-9575-370313a39483-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:55 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=92,cinder:UPDATE=84,cinder:DELETE=8,cinder:INSERT=16 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:44:55 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=81,cinder:INSERT=24,cinder:UPDATE=84,cinder:DELETE=7 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:44:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Acquiring lock "cinder-quobyte-fe92c9d9-7ac2-4601-9575-370313a39483" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "cinder-quobyte-fe92c9d9-7ac2-4601-9575-370313a39483" acquired by "delete_volume" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:55 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ba0431-7b78-415e-b197-30bdfa713a19]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:55 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483 Jul 15 18:44:55 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:56 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483" returned: 0 in 0.386s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:56 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483 Jul 15 18:44:56 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:56 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fe92c9d9-7ac2-4601-9575-370313a39483" returned: 0 in 0.265s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "cinder-quobyte-fe92c9d9-7ac2-4601-9575-370313a39483" released by "delete_volume" :: held 0.694s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Created reservations ['2640eeb9-1207-45fe-b36d-098023189518', 'c0622b1a-81fb-4285-aad6-550c589d3ec6', '81df5673-6709-4414-861d-530f21a3163a', 'cda20aad-04ba-4179-98bf-978d3130fb3e'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:56 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:44:56 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Acquiring lock "cinder-43faa78e-2b8e-4cdd-a825-47f9ddfd406e-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:56 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.271s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:56 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Deleted volume successfully. Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "cinder-43faa78e-2b8e-4cdd-a825-47f9ddfd406e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-794ebba9-b1f8-419b-89d8-486970b624db tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "cinder-fe92c9d9-7ac2-4601-9575-370313a39483-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Acquiring lock "cinder-quobyte-43faa78e-2b8e-4cdd-a825-47f9ddfd406e" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:44:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "cinder-quobyte-43faa78e-2b8e-4cdd-a825-47f9ddfd406e" acquired by "delete_volume" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af981de-dab9-44a5-91ea-daf3ca8debe5]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:57 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e Jul 15 18:44:57 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:57 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e" returned: 0 in 0.402s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:57 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e Jul 15 18:44:57 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:57 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-43faa78e-2b8e-4cdd-a825-47f9ddfd406e" returned: 0 in 0.283s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "cinder-quobyte-43faa78e-2b8e-4cdd-a825-47f9ddfd406e" released by "delete_volume" :: held 0.739s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Created reservations ['055891da-74f1-4fce-a7fb-c26e9ef2c0e6', 'c1eeb2cb-6d56-4109-bfd9-4109cf23d06d', 'b586a8a8-fef9-4f88-a9f4-50da09ce91ab', '1a7b60bd-3620-4798-b544-ddb27c93ffd4'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:44:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:44:57 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:44:57 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:44:58 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Jul 15 18:44:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.271s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:44:58 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:44:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Deleted volume successfully. Jul 15 18:44:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b5a33584-97c4-4ce3-93c0-a51bdde96be8 tempest-TestServerVolumeAttachmentScenario-1741018821 None] Lock "cinder-43faa78e-2b8e-4cdd-a825-47f9ddfd406e-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:07 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=17 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:45:08 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=8,cinder:INSERT=5,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Flow 'volume_create_manager' (a436c42e-c357-4c3f-8bd9-0ae13587f70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef445f6-e4cd-400c-8ed4-0e4fc0bc3891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef445f6-e4cd-400c-8ed4-0e4fc0bc3891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1099927561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ef1ead-cb14-4afa-995e-b777fa08978d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b032e567d147d78c18cbfa3280fd57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:14Z,use_quota=True,user_id='13d7505b74d246b0a63ca90713ed0815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecd11e4-5602-4280-9894-f2e3df540a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecd11e4-5602-4280-9894-f2e3df540a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2920ab56-16fd-48ee-bcbc-bcdb38be85f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.image.glance [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Creating Keystone auth plugin from conf {{(pid=87217) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2920ab56-16fd-48ee-bcbc-bcdb38be85f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e6ef1ead-cb14-4afa-995e-b777fa08978d', 'volume_name': 'volume-e6ef1ead-cb14-4afa-995e-b777fa08978d', 'volume_size': 1, 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1cc7d7f865b4961944a3804db21f9fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'created_at': datetime.datetime(2026, 7, 15, 16, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58cd658a-6d16-40ff-85de-7b9a03ec1256/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45996a5-8af7-4aa2-a5b3-f0d5f52d183f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45996a5-8af7-4aa2-a5b3-f0d5f52d183f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ce460a-e257-4f18-825c-aab0df5f5a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:14 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Volume e6ef1ead-cb14-4afa-995e-b777fa08978d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e6ef1ead-cb14-4afa-995e-b777fa08978d', 'volume_size': 1, 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1cc7d7f865b4961944a3804db21f9fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'created_at': datetime.datetime(2026, 7, 15, 16, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58cd658a-6d16-40ff-85de-7b9a03ec1256/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 15 18:45:14 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Trying to clone e6ef1ead-cb14-4afa-995e-b777fa08978d from image 58cd658a-6d16-40ff-85de-7b9a03ec1256 at location (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]). {{(pid=87217) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:45:15 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Image download 20.69 MB at 20.69 MB/s Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e759b3-db59-4cf5-80f0-7d4f3f1cba00]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:15 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD Jul 15 18:45:15 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Flow 'volume_create_manager' (f6be19e6-c9d0-4573-b506-f8bb108a565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d0ca0f-7372-4a3f-8e6c-9de5eb383f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d0ca0f-7372-4a3f-8e6c-9de5eb383f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2542e097-38dc-40aa-9f1b-cb7c0b9aa895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1679b26f8c0945f5a0fc0fd125625f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:15Z,use_quota=True,user_id='8f6096253c774b32846300d3395eccc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6565ad76-918b-49a4-91e5-e2a479fa750d),volume_type_id=6565ad76-918b-49a4-91e5-e2a479fa750d)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59743004-2730-4caf-a65f-10a4e89397ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59743004-2730-4caf-a65f-10a4e89397ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c144fbe-3841-403c-9308-a8b717fddaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.image.glance [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Creating Keystone auth plugin from conf {{(pid=87217) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:45:15 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Temporary image 58cd658a-6d16-40ff-85de-7b9a03ec1256 is fetched for user 13d7505b74d246b0a63ca90713ed0815. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[221f7bb0-820a-4838-9352-c316665967c8]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c144fbe-3841-403c-9308-a8b717fddaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2542e097-38dc-40aa-9f1b-cb7c0b9aa895', 'volume_name': 'volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895', 'volume_size': 1, 'image_id': 'b9b59f98-29df-40a0-bb93-5bf45086350d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9b59f98-29df-40a0-bb93-5bf45086350d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01556bae12c40bc394237052deaa7677', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1679b26f8c0945f5a0fc0fd125625f38', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '330fde96339b27d1e2819ce880aea4d1ccabd9292b83d265f219a4238ce946217f9478e52fbf40ab3c3a2f65a30417304513fa36fd9cf1b42fff056675b6314d', 'id': 'b9b59f98-29df-40a0-bb93-5bf45086350d', 'created_at': datetime.datetime(2026, 7, 15, 16, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 45, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9b59f98-29df-40a0-bb93-5bf45086350d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f979ef4e-7305-4b0b-86bb-d6ebd18d19e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f979ef4e-7305-4b0b-86bb-d6ebd18d19e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad18ce9c-9e41-41e7-bebe-deb417ce06f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:15 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Volume 2542e097-38dc-40aa-9f1b-cb7c0b9aa895: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895', 'volume_size': 1, 'image_id': 'b9b59f98-29df-40a0-bb93-5bf45086350d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9b59f98-29df-40a0-bb93-5bf45086350d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01556bae12c40bc394237052deaa7677', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1679b26f8c0945f5a0fc0fd125625f38', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '330fde96339b27d1e2819ce880aea4d1ccabd9292b83d265f219a4238ce946217f9478e52fbf40ab3c3a2f65a30417304513fa36fd9cf1b42fff056675b6314d', 'id': 'b9b59f98-29df-40a0-bb93-5bf45086350d', 'created_at': datetime.datetime(2026, 7, 15, 16, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 45, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9b59f98-29df-40a0-bb93-5bf45086350d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Trying to clone 2542e097-38dc-40aa-9f1b-cb7c0b9aa895 from image b9b59f98-29df-40a0-bb93-5bf45086350d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9b59f98-29df-40a0-bb93-5bf45086350d', 'metadata': {}}]). {{(pid=87217) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:45:15 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD Jul 15 18:45:15 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:45:15 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Image download 0.00 MB at 0.00 MB/s Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[61df7361-d4ea-4f5d-a847-4b31fcd2e0a1]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:15 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD Jul 15 18:45:15 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:16 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1099927561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ef1ead-cb14-4afa-995e-b777fa08978d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b032e567d147d78c18cbfa3280fd57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:14Z,use_quota=True,user_id='13d7505b74d246b0a63ca90713ed0815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Creating volume e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:16 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:16 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d 1073741824 Jul 15 18:45:16 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:16 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:16 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD Jul 15 18:45:16 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:16 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d 1073741824" returned: 0 in 0.407s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:16 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:16 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d Jul 15 18:45:16 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Temporary image b9b59f98-29df-40a0-bb93-5bf45086350d is fetched for user 8f6096253c774b32846300d3395eccc1. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[0087f65c-c1f3-442e-82c8-84132090e752]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:16 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD Jul 15 18:45:16 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:16 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d" returned: 0 in 0.262s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Attempting download of 58cd658a-6d16-40ff-85de-7b9a03ec1256 ((None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}])) to volume e6ef1ead-cb14-4afa-995e-b777fa08978d. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d0e174-cc06-4976-824e-9357bb2c03c6]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_wqnpoqpv {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:16 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:16 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_wqnpoqpv Jul 15 18:45:16 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:17 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD Jul 15 18:45:17 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:17 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_wqnpoqpv" returned: 0 in 0.327s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_wqnpoqpv {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:17 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2542e097-38dc-40aa-9f1b-cb7c0b9aa895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1679b26f8c0945f5a0fc0fd125625f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:15Z,use_quota=True,user_id='8f6096253c774b32846300d3395eccc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6565ad76-918b-49a4-91e5-e2a479fa750d),volume_type_id=6565ad76-918b-49a4-91e5-e2a479fa750d)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Creating volume 2542e097-38dc-40aa-9f1b-cb7c0b9aa895 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:17 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_wqnpoqpv Jul 15 18:45:17 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:17 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:17 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 1073741824 Jul 15 18:45:17 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:17 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_wqnpoqpv" returned: 1 in 0.319s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58cd658a-6d16-40ff-85de-7b9a03ec1256_wqnpoqpv' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[29323977-9dcd-4407-8eb1-0e5e77b9c6a7]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:17 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD Jul 15 18:45:17 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:17 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 1073741824" returned: 0 in 0.474s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:17 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 Jul 15 18:45:17 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:17 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] 58cd658a-6d16-40ff-85de-7b9a03ec1256 was qcow2, converting to raw {{(pid=87217) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:45:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:17 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d Jul 15 18:45:17 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:18 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895" returned: 0 in 0.257s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:45:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:18 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Attempting download of b9b59f98-29df-40a0-bb93-5bf45086350d ((None, [{'url': 'file:///opt/stack/data/glance/images/b9b59f98-29df-40a0-bb93-5bf45086350d', 'metadata': {}}])) to volume 2542e097-38dc-40aa-9f1b-cb7c0b9aa895. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:45:18 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[c629bb57-4f51-489b-b14f-9fafec876c3d]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9b59f98-29df-40a0-bb93-5bf45086350d_cnb60b_d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:18 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9b59f98-29df-40a0-bb93-5bf45086350d_cnb60b_d Jul 15 18:45:18 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:18 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9b59f98-29df-40a0-bb93-5bf45086350d_cnb60b_d" returned: 0 in 0.395s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9b59f98-29df-40a0-bb93-5bf45086350d_cnb60b_d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:18 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9b59f98-29df-40a0-bb93-5bf45086350d_cnb60b_d Jul 15 18:45:18 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:18 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9b59f98-29df-40a0-bb93-5bf45086350d_cnb60b_d" returned: 1 in 0.395s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9b59f98-29df-40a0-bb93-5bf45086350d_cnb60b_d' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:18 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3978db1c-d9a4-46c3-97de-e2d6afe170df]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:19 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD Jul 15 18:45:19 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:19 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:19 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d" returned: 0 in 1.426s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_58cd658a-6d16-40ff-85de-7b9a03ec1256_zce_8m95devstack@QuobyteHD, size 112.00 MB, duration 1.43 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:45:19 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Converted 112.00 MB image at 78.44 MB/s Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:19 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d 1G Jul 15 18:45:19 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:19 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD Jul 15 18:45:19 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:19 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] b9b59f98-29df-40a0-bb93-5bf45086350d was raw, converting to raw {{(pid=87217) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:19 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d 1G" returned: 0 in 0.321s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:19 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 Jul 15 18:45:19 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7602c0-d87f-4176-849f-ba23e6bb066a]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:19 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d Jul 15 18:45:19 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:19 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895" returned: 0 in 0.335s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9b59f98-29df-40a0-bb93-5bf45086350d_w1ouvgvfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:45:19 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Converted 0.00 MB image at 0.00 MB/s Jul 15 18:45:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:19 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 1G Jul 15 18:45:19 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:20 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d" returned: 0 in 0.367s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:20 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d Jul 15 18:45:20 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:20 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 1G" returned: 0 in 0.290s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[438084f9-2c49-4258-b4ff-50bdc13c4f2d]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:20 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d" returned: 1 in 0.340s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Downloaded image 58cd658a-6d16-40ff-85de-7b9a03ec1256 ((None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}])) to volume e6ef1ead-cb14-4afa-995e-b777fa08978d successfully. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Temporary image 58cd658a-6d16-40ff-85de-7b9a03ec1256 for user 13d7505b74d246b0a63ca90713ed0815 is deleted. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Marking volume e6ef1ead-cb14-4afa-995e-b777fa08978d as bootable. {{(pid=87217) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Copying metadata from image 58cd658a-6d16-40ff-85de-7b9a03ec1256 to e6ef1ead-cb14-4afa-995e-b777fa08978d. {{(pid=87217) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Creating volume glance metadata for volume e6ef1ead-cb14-4afa-995e-b777fa08978d backed by image 58cd658a-6d16-40ff-85de-7b9a03ec1256 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87217) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:45:20 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 Jul 15 18:45:20 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ce460a-e257-4f18-825c-aab0df5f5a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6ef1ead-cb14-4afa-995e-b777fa08978d', 'volume_size': 1, 'image_id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58cd658a-6d16-40ff-85de-7b9a03ec1256', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e1cc7d7f865b4961944a3804db21f9fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58cd658a-6d16-40ff-85de-7b9a03ec1256', 'created_at': datetime.datetime(2026, 7, 15, 16, 22, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 22, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58cd658a-6d16-40ff-85de-7b9a03ec1256/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24dd8c1-f769-4533-a882-c48495514083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:20 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Volume volume-e6ef1ead-cb14-4afa-995e-b777fa08978d (e6ef1ead-cb14-4afa-995e-b777fa08978d): created successfully Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24dd8c1-f769-4533-a882-c48495514083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Flow 'volume_create_manager' (a436c42e-c357-4c3f-8bd9-0ae13587f70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:20 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-350d4ea2-1214-46b7-b855-0632fed482d8 tempest-TestShelveInstance-1394276225 None] Created volume successfully. Jul 15 18:45:20 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895" returned: 0 in 0.367s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:20 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 Jul 15 18:45:20 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:21 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895" returned: 1 in 0.347s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Downloaded image b9b59f98-29df-40a0-bb93-5bf45086350d ((None, [{'url': 'file:///opt/stack/data/glance/images/b9b59f98-29df-40a0-bb93-5bf45086350d', 'metadata': {}}])) to volume 2542e097-38dc-40aa-9f1b-cb7c0b9aa895 successfully. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Temporary image b9b59f98-29df-40a0-bb93-5bf45086350d for user 8f6096253c774b32846300d3395eccc1 is deleted. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Marking volume 2542e097-38dc-40aa-9f1b-cb7c0b9aa895 as bootable. {{(pid=87217) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Copying metadata from image b9b59f98-29df-40a0-bb93-5bf45086350d to 2542e097-38dc-40aa-9f1b-cb7c0b9aa895. {{(pid=87217) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Creating volume glance metadata for volume 2542e097-38dc-40aa-9f1b-cb7c0b9aa895 backed by image b9b59f98-29df-40a0-bb93-5bf45086350d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b9b59f98-29df-40a0-bb93-5bf45086350d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '01556bae12c40bc394237052deaa7677', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87217) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad18ce9c-9e41-41e7-bebe-deb417ce06f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895', 'volume_size': 1, 'image_id': 'b9b59f98-29df-40a0-bb93-5bf45086350d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9b59f98-29df-40a0-bb93-5bf45086350d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01556bae12c40bc394237052deaa7677', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1679b26f8c0945f5a0fc0fd125625f38', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '330fde96339b27d1e2819ce880aea4d1ccabd9292b83d265f219a4238ce946217f9478e52fbf40ab3c3a2f65a30417304513fa36fd9cf1b42fff056675b6314d', 'id': 'b9b59f98-29df-40a0-bb93-5bf45086350d', 'created_at': datetime.datetime(2026, 7, 15, 16, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 45, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9b59f98-29df-40a0-bb93-5bf45086350d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e712bc-c6ac-4b2f-b7b4-1a33639f44d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:21 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Volume volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 (2542e097-38dc-40aa-9f1b-cb7c0b9aa895): created successfully Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e712bc-c6ac-4b2f-b7b4-1a33639f44d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Flow 'volume_create_manager' (f6be19e6-c9d0-4573-b506-f8bb108a565b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:21 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-3067b90a-4ae0-43eb-beea-27451f72e557 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Created volume successfully. Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Acquiring lock "cinder-2542e097-38dc-40aa-9f1b-cb7c0b9aa895-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Lock "cinder-2542e097-38dc-40aa-9f1b-cb7c0b9aa895-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Acquiring lock "cinder-quobyte-2542e097-38dc-40aa-9f1b-cb7c0b9aa895" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Lock "cinder-quobyte-2542e097-38dc-40aa-9f1b-cb7c0b9aa895" acquired by "delete_volume" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eec405-6816-4d91-8d32-052eacfc376d]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:22 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 Jul 15 18:45:22 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:22 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895" returned: 0 in 0.365s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:22 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 Jul 15 18:45:22 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:22 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895" returned: 1 in 0.370s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:22 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895 Jul 15 18:45:22 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:22 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2542e097-38dc-40aa-9f1b-cb7c0b9aa895" returned: 0 in 0.307s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Lock "cinder-quobyte-2542e097-38dc-40aa-9f1b-cb7c0b9aa895" released by "delete_volume" :: held 1.108s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:23 devstack cinder-volume[87217]: WARNING cinder.quota [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:45:23 devstack cinder-volume[87217]: WARNING cinder.quota [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Created reservations ['a6eae08d-0692-4043-88b3-8b9943907bea', '391aa7cf-2425-433e-a039-60e2feeee223', 'b26afed4-dabc-4ca6-879b-437f932593bd', 'f3e05040-a234-4ab3-9f00-f5a134c83c01'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:23 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:45:23 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:23 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.274s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:45:23 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Deleted volume successfully. Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d0d4b398-cfbc-4ede-9072-b95093955474 tempest-VolumeAndVolumeTypeFromImageTest-1642577626 None] Lock "cinder-2542e097-38dc-40aa-9f1b-cb7c0b9aa895-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-a4037e87-38cf-441a-be69-3c0b7ef92959 req-ca9c855e-5bd7-4133-8fee-803a46ef46c5 tempest-TestShelveInstance-1394276225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-a4037e87-38cf-441a-be69-3c0b7ef92959 req-ca9c855e-5bd7-4133-8fee-803a46ef46c5 tempest-TestShelveInstance-1394276225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c11a5bb-40cd-4490-b3b7-20a2c7d6563e]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-a4037e87-38cf-441a-be69-3c0b7ef92959 req-ca9c855e-5bd7-4133-8fee-803a46ef46c5 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:23 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d Jul 15 18:45:23 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:23 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-a4037e87-38cf-441a-be69-3c0b7ef92959 req-ca9c855e-5bd7-4133-8fee-803a46ef46c5 tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d" returned: 0 in 0.396s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-a4037e87-38cf-441a-be69-3c0b7ef92959 req-ca9c855e-5bd7-4133-8fee-803a46ef46c5 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:24 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d Jul 15 18:45:24 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:24 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-a4037e87-38cf-441a-be69-3c0b7ef92959 req-ca9c855e-5bd7-4133-8fee-803a46ef46c5 tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d" returned: 1 in 0.417s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-a4037e87-38cf-441a-be69-3c0b7ef92959 req-ca9c855e-5bd7-4133-8fee-803a46ef46c5 tempest-TestShelveInstance-1394276225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-a4037e87-38cf-441a-be69-3c0b7ef92959 req-ca9c855e-5bd7-4133-8fee-803a46ef46c5 tempest-TestShelveInstance-1394276225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.854s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-a4037e87-38cf-441a-be69-3c0b7ef92959 req-ca9c855e-5bd7-4133-8fee-803a46ef46c5 tempest-TestShelveInstance-1394276225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-e6ef1ead-cb14-4afa-995e-b777fa08978d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18b7cc5c-3546-492f-b645-022909fab9c2', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:45:24 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-a4037e87-38cf-441a-be69-3c0b7ef92959 req-ca9c855e-5bd7-4133-8fee-803a46ef46c5 tempest-TestShelveInstance-1394276225 None] attachment_update completed successfully. Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Flow 'volume_create_manager' (633f5b19-ca3c-4e76-9bd5-939fd105089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1451b8-c3c9-4bdb-90b6-6f2d53e4a497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1451b8-c3c9-4bdb-90b6-6f2d53e4a497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1140709834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a1d0bb56794fc1ae713b917bbb286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:30Z,use_quota=True,user_id='51f340bc68354a14a0295941bda29206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13f61b2-8c98-493b-b8d3-69e4a53bc456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13f61b2-8c98-493b-b8d3-69e4a53bc456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7b3eb7-86d5-41cd-879d-3b0ad3cef8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7b3eb7-86d5-41cd-879d-3b0ad3cef8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c', 'volume_name': 'volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb85e11-3f5c-46f3-838f-a6eae74044ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb85e11-3f5c-46f3-838f-a6eae74044ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f4381d-759c-470b-b501-d01321367201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:29 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Volume aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c', 'volume_size': 1} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1140709834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a1d0bb56794fc1ae713b917bbb286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:30Z,use_quota=True,user_id='51f340bc68354a14a0295941bda29206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Creating volume aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:29 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:45:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:29 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c 1073741824 Jul 15 18:45:29 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:30 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c 1073741824" returned: 0 in 0.549s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:30 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c Jul 15 18:45:30 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:30 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" returned: 0 in 0.323s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:45:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f4381d-759c-470b-b501-d01321367201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d842eb1-bc0d-44e8-9930-638fdafd7323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:30 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Volume volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c (aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c): created successfully Jul 15 18:45:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d842eb1-bc0d-44e8-9930-638fdafd7323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Flow 'volume_create_manager' (633f5b19-ca3c-4e76-9bd5-939fd105089b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0f7477a5-dc0c-4227-bf8b-eae3528c905d tempest-VolumeDependencyTests-1059982516 None] Created volume successfully. Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] Creating offline snapshot e07ef1dd-11df-4b78-be27-620f754501fe of volume aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2574d959-89e8-4bde-8492-74119cc5ecbb]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:32 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c Jul 15 18:45:32 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:32 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" returned: 0 in 0.457s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:32 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe 1G Jul 15 18:45:32 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:32 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:45:32 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:33 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.381s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:45:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:45:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:45:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:45:33 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe 1G" returned: 0 in 0.585s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:33 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe Jul 15 18:45:33 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:33 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe" returned: 0 in 0.317s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:33 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe is being set with open permissions: ugo+rw Jul 15 18:45:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:33 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe Jul 15 18:45:33 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:33 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe" returned: 0 in 0.268s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:33 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.info Jul 15 18:45:33 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:34 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.info" returned: 0 in 0.259s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:34 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.info is being set with open permissions: ugo+rw Jul 15 18:45:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:34 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.info Jul 15 18:45:34 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:34 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.info" returned: 0 in 0.271s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:34 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6b8952b8-7bfb-4979-8d2f-de39ef71b145 tempest-VolumeDependencyTests-1059982516 None] Create snapshot completed successfully Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Flow 'volume_create_manager' (7d0eb3f9-1d84-4b63-af9e-22dcdc4c091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0faa0ec2-f811-42fb-b7bd-9a4097f2d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0faa0ec2-f811-42fb-b7bd-9a4097f2d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2017725399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e075716b-2df5-40c9-a34a-bc287998028a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a1d0bb56794fc1ae713b917bbb286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e07ef1dd-11df-4b78-be27-620f754501fe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:45:36Z,use_quota=True,user_id='51f340bc68354a14a0295941bda29206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc3bf0f-6ad0-4dd5-a863-fc69af5d7078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc3bf0f-6ad0-4dd5-a863-fc69af5d7078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1120260-c85f-4406-b7d7-3d2d41e33222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1120260-c85f-4406-b7d7-3d2d41e33222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e075716b-2df5-40c9-a34a-bc287998028a', 'volume_name': 'volume-e075716b-2df5-40c9-a34a-bc287998028a', 'volume_size': 1, 'snapshot_id': 'e07ef1dd-11df-4b78-be27-620f754501fe'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbd51b0-2064-40db-a309-dffbe1611db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbd51b0-2064-40db-a309-dffbe1611db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e128ef11-add8-4cca-aa63-42857373ce6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:35 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Volume e075716b-2df5-40c9-a34a-bc287998028a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e075716b-2df5-40c9-a34a-bc287998028a', 'volume_size': 1, 'snapshot_id': 'e07ef1dd-11df-4b78-be27-620f754501fe'} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:35 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "cinder-quobyte-e07ef1dd-11df-4b78-be27-620f754501fe-e075716b-2df5-40c9-a34a-bc287998028a" by "_create_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-quobyte-e07ef1dd-11df-4b78-be27-620f754501fe-e075716b-2df5-40c9-a34a-bc287998028a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Creating volume e075716b-2df5-40c9-a34a-bc287998028a from snapshot e07ef1dd-11df-4b78-be27-620f754501fe {{(pid=87217) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "cinder-quobyte-e075716b-2df5-40c9-a34a-bc287998028a" by "_copy_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-quobyte-e075716b-2df5-40c9-a34a-bc287998028a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] snapshot: e07ef1dd-11df-4b78-be27-620f754501fe, volume: e075716b-2df5-40c9-a34a-bc287998028a, {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b257ee-4ac7-44fc-b9a5-07d54e3e9c90]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:36 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe Jul 15 18:45:36 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:36 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe" returned: 0 in 0.379s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Creating direct copy from snapshot {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b10bef-2fcf-4517-803d-dcc753c41df5]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:36 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c Jul 15 18:45:36 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:36 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" returned: 0 in 0.369s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG cinder.utils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Path /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a not found in is_blk_device check {{(pid=87217) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:45:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:36 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a Jul 15 18:45:36 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:41 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a" returned: 0 in 5.034s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:41 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdf3948-eb66-4780-943e-892b18084678]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:41 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c Jul 15 18:45:41 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:42 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" returned: 0 in 0.503s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:42 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:45:42 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Converted 1024.00 MB image at 203.37 MB/s Jul 15 18:45:42 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a is being set with open permissions: ugo+rw Jul 15 18:45:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:42 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a Jul 15 18:45:42 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:42 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a" returned: 0 in 0.243s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-quobyte-e075716b-2df5-40c9-a34a-bc287998028a" released by "_copy_volume_from_snapshot" :: held 6.609s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-quobyte-e07ef1dd-11df-4b78-be27-620f754501fe-e075716b-2df5-40c9-a34a-bc287998028a" released by "_create_volume_from_snapshot" :: held 6.639s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.657s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e128ef11-add8-4cca-aa63-42857373ce6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e075716b-2df5-40c9-a34a-bc287998028a', 'volume_size': 1, 'snapshot_id': 'e07ef1dd-11df-4b78-be27-620f754501fe'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14851ec5-a2f7-425d-a77f-fd5a6f66f0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:45:42 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Volume volume-e075716b-2df5-40c9-a34a-bc287998028a (e075716b-2df5-40c9-a34a-bc287998028a): created successfully Jul 15 18:45:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14851ec5-a2f7-425d-a77f-fd5a6f66f0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:45:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Flow 'volume_create_manager' (7d0eb3f9-1d84-4b63-af9e-22dcdc4c091d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:45:42 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-014ad26a-f591-4662-9389-319f5d4a0bf6 tempest-VolumeDependencyTests-1059982516 None] Created volume successfully. Jul 15 18:45:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "cinder-e07ef1dd-11df-4b78-be27-620f754501fe-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-e07ef1dd-11df-4b78-be27-620f754501fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "cinder-quobyte-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-quobyte-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "cinder-quobyte-e07ef1dd-11df-4b78-be27-620f754501fe" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-quobyte-e07ef1dd-11df-4b78-be27-620f754501fe" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Deleting offline snapshot e07ef1dd-11df-4b78-be27-620f754501fe of volume aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:45:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] snapshot_file for this snap is: volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:45:43 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb559a0-2045-45df-ba3a-8d34f46fad9d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:44 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe Jul 15 18:45:44 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:44 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe" returned: 0 in 0.380s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:45:44 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9977372-8067-4e05-a303-03c749c5df27]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:44 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c Jul 15 18:45:44 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:44 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" returned: 0 in 0.348s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:44 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe Jul 15 18:45:44 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:45 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe" returned: 0 in 0.324s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:45 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe Jul 15 18:45:45 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:45 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c.e07ef1dd-11df-4b78-be27-620f754501fe" returned: 0 in 0.233s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-quobyte-e07ef1dd-11df-4b78-be27-620f754501fe" released by "_delete_snapshot" :: held 1.391s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-quobyte-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" released by "delete_snapshot" :: held 1.422s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:45 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Created reservations ['56535469-de81-46f2-af6e-2eb99c3cfee3', 'e5da87d5-dff2-4e15-8d5a-512dce0ef218', '327f503a-6019-4563-9188-dd4b7872fecb', '3f72eb25-091d-4c04-a63b-ec4776bfaeca'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:45 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Delete snapshot completed successfully. Jul 15 18:45:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1ce27103-dc28-4698-a524-f743378937ec tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-e07ef1dd-11df-4b78-be27-620f754501fe-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "cinder-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "cinder-quobyte-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-quobyte-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" acquired by "delete_volume" :: waited 0.013s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b963f7c-7229-42e0-baab-abe104c48141]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:46 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c Jul 15 18:45:46 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:46 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" returned: 0 in 0.346s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:46 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c Jul 15 18:45:46 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:46 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" returned: 0 in 0.235s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-quobyte-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c" released by "delete_volume" :: held 0.633s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Created reservations ['d619cc9d-7193-4e2a-aba3-e50107235fbc', '67cdbb5a-76ad-49b9-a034-8a3d1df9b9ca', 'a478a90c-4c6f-4919-af51-93ea8bf2b69e', 'ceff9cb3-d811-4e8e-94da-e92d1b7d899a'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:46 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:45:46 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:47 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.232s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:45:47 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Deleted volume successfully. Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d7c9c322-d02f-447c-a8b3-2542acb13534 tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-aae2b6da-7f85-4e69-b0f8-e1fa5bcfb86c-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "cinder-e075716b-2df5-40c9-a34a-bc287998028a-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-e075716b-2df5-40c9-a34a-bc287998028a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "cinder-quobyte-e075716b-2df5-40c9-a34a-bc287998028a" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-quobyte-e075716b-2df5-40c9-a34a-bc287998028a" acquired by "delete_volume" :: waited 0.013s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b05144-cbac-4760-b6dd-f8c11743d89e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:47 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a Jul 15 18:45:47 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:47 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a" returned: 0 in 0.345s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:47 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a Jul 15 18:45:47 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:47 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e075716b-2df5-40c9-a34a-bc287998028a" returned: 0 in 0.239s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-quobyte-e075716b-2df5-40c9-a34a-bc287998028a" released by "delete_volume" :: held 0.619s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Created reservations ['1ca38c60-e383-4e5c-a056-2147be121702', 'fd5574e1-509c-4d10-8e51-7686b0b9cec0', '20bca824-466e-433c-bc63-6ee075f56562', 'faae0146-eedb-41cf-95e0-99892e09bad9'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:47 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:45:47 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:48 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.257s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:48 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:45:48 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Deleted volume successfully. Jul 15 18:45:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e813d2e2-ad91-4bca-8edb-d3c6d4bae45e tempest-VolumeDependencyTests-1059982516 None] Lock "cinder-e075716b-2df5-40c9-a34a-bc287998028a-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:45:55 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-732659dd-7fcc-492d-9d6f-279d92a49669 req-9b3efb9c-1419-4265-adf0-4d85f120d48a tempest-TestShelveInstance-1394276225 None] Terminate volume connection completed successfully. Jul 15 18:45:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-732659dd-7fcc-492d-9d6f-279d92a49669 req-9b3efb9c-1419-4265-adf0-4d85f120d48a tempest-TestShelveInstance-1394276225 None] Deleting attachment 18b7cc5c-3546-492f-b645-022909fab9c2. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:45:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-d266b33a-fc13-43c5-8f4f-ce58e23d2d41 req-73d19b73-f7f0-4817-91ac-fa38c1b07f6b tempest-TestShelveInstance-1394276225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:45:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-d266b33a-fc13-43c5-8f4f-ce58e23d2d41 req-73d19b73-f7f0-4817-91ac-fa38c1b07f6b tempest-TestShelveInstance-1394276225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:45:57 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[32de3909-b613-4342-b692-846b8b3d2f4a]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:45:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-d266b33a-fc13-43c5-8f4f-ce58e23d2d41 req-73d19b73-f7f0-4817-91ac-fa38c1b07f6b tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:57 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d Jul 15 18:45:57 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:57 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-d266b33a-fc13-43c5-8f4f-ce58e23d2d41 req-73d19b73-f7f0-4817-91ac-fa38c1b07f6b tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d" returned: 0 in 0.400s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-d266b33a-fc13-43c5-8f4f-ce58e23d2d41 req-73d19b73-f7f0-4817-91ac-fa38c1b07f6b tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:45:58 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d Jul 15 18:45:58 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:45:58 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 15 18:45:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-d266b33a-fc13-43c5-8f4f-ce58e23d2d41 req-73d19b73-f7f0-4817-91ac-fa38c1b07f6b tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d" returned: 1 in 0.341s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:45:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-d266b33a-fc13-43c5-8f4f-ce58e23d2d41 req-73d19b73-f7f0-4817-91ac-fa38c1b07f6b tempest-TestShelveInstance-1394276225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:45:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-d266b33a-fc13-43c5-8f4f-ce58e23d2d41 req-73d19b73-f7f0-4817-91ac-fa38c1b07f6b tempest-TestShelveInstance-1394276225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.790s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:45:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-d266b33a-fc13-43c5-8f4f-ce58e23d2d41 req-73d19b73-f7f0-4817-91ac-fa38c1b07f6b tempest-TestShelveInstance-1394276225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d', 'name': 'volume-e6ef1ead-cb14-4afa-995e-b777fa08978d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed505af3-55b7-4818-843c-c301536494b6', 'enforce_multipath': True} {{(pid=87217) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 15 18:45:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-d266b33a-fc13-43c5-8f4f-ce58e23d2d41 req-73d19b73-f7f0-4817-91ac-fa38c1b07f6b tempest-TestShelveInstance-1394276225 None] attachment_update completed successfully. Jul 15 18:46:08 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=42,cinder:SELECT=56,cinder:INSERT=23,cinder:DELETE=3 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:46:08 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=61,cinder:UPDATE=55,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Flow 'volume_create_manager' (a174dbae-7c64-45a0-809d-9f222c7e873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2226783c-7aab-4efe-a81b-7f6914ec3e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2226783c-7aab-4efe-a81b-7f6914ec3e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-487931866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76763ca-a066-4495-bf36-7c0d311933a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028afa816ca14c4bbc23e9ac7221dd4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:15Z,use_quota=True,user_id='201f57b61e34497bae911aef9531d4ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68997384-f2f5-43e9-b68f-8e4bf3a55a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68997384-f2f5-43e9-b68f-8e4bf3a55a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7e7b65-65ab-4b89-bf4f-72696b36647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7e7b65-65ab-4b89-bf4f-72696b36647c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a76763ca-a066-4495-bf36-7c0d311933a4', 'volume_name': 'volume-a76763ca-a066-4495-bf36-7c0d311933a4', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0611d64d-3632-40c1-9791-5075a535dc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0611d64d-3632-40c1-9791-5075a535dc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22def66b-2397-4070-ad19-7b4be6bd22fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:15 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Volume a76763ca-a066-4495-bf36-7c0d311933a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a76763ca-a066-4495-bf36-7c0d311933a4', 'volume_size': 1} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-487931866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76763ca-a066-4495-bf36-7c0d311933a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028afa816ca14c4bbc23e9ac7221dd4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:15Z,use_quota=True,user_id='201f57b61e34497bae911aef9531d4ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Creating volume a76763ca-a066-4495-bf36-7c0d311933a4 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:46:15 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:15 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 1073741824 Jul 15 18:46:15 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:15 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 1073741824" returned: 0 in 0.428s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:15 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 Jul 15 18:46:15 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:16 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4" returned: 0 in 0.257s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:46:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22def66b-2397-4070-ad19-7b4be6bd22fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a76763ca-a066-4495-bf36-7c0d311933a4', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51745a9e-2d64-4459-be6c-9375df0752b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:16 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Volume volume-a76763ca-a066-4495-bf36-7c0d311933a4 (a76763ca-a066-4495-bf36-7c0d311933a4): created successfully Jul 15 18:46:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51745a9e-2d64-4459-be6c-9375df0752b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Flow 'volume_create_manager' (a174dbae-7c64-45a0-809d-9f222c7e873e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:16 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ca70c961-edd2-4b74-8760-9f4e7257a3d1 tempest-SnapshotDependencyTests-812924908 None] Created volume successfully. Jul 15 18:46:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] Creating offline snapshot 445c6aa6-f46c-4097-88db-5eae7b8eaf9a of volume a76763ca-a066-4495-bf36-7c0d311933a4 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:46:16 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef0d086-6140-4804-a1bd-b96e6194e9fc]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:16 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 Jul 15 18:46:16 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:16 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4" returned: 0 in 0.375s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:17 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a 1G Jul 15 18:46:17 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:17 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a 1G" returned: 0 in 0.412s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a76763ca-a066-4495-bf36-7c0d311933a4 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:17 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a76763ca-a066-4495-bf36-7c0d311933a4 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a Jul 15 18:46:17 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:17 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a76763ca-a066-4495-bf36-7c0d311933a4 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a" returned: 0 in 0.299s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:17 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a is being set with open permissions: ugo+rw Jul 15 18:46:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:17 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a Jul 15 18:46:17 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:17 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a" returned: 0 in 0.262s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:18 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.info Jul 15 18:46:18 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:18 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.info" returned: 0 in 0.271s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:18 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.info is being set with open permissions: ugo+rw Jul 15 18:46:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:18 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.info Jul 15 18:46:18 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:18 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.info" returned: 0 in 0.247s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:18 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-558b1f47-dcd2-47b8-b34a-778e3b0250a0 tempest-SnapshotDependencyTests-812924908 None] Create snapshot completed successfully Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Flow 'volume_create_manager' (7704ef87-f311-4f04-ba97-ca449c1d30e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6033cf8-b69c-48b7-bec3-4ece08ca0112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6033cf8-b69c-48b7-bec3-4ece08ca0112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c058077c-91b4-4169-8313-ffebaef2e53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028afa816ca14c4bbc23e9ac7221dd4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=445c6aa6-f46c-4097-88db-5eae7b8eaf9a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:19Z,use_quota=True,user_id='201f57b61e34497bae911aef9531d4ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e41783-2a90-4375-9060-c901fdf28e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e41783-2a90-4375-9060-c901fdf28e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1067f8fb-67a6-411e-ad20-f7f22885bb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1067f8fb-67a6-411e-ad20-f7f22885bb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c058077c-91b4-4169-8313-ffebaef2e53c', 'volume_name': 'volume-c058077c-91b4-4169-8313-ffebaef2e53c', 'volume_size': 1, 'snapshot_id': '445c6aa6-f46c-4097-88db-5eae7b8eaf9a'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b49da2a-d763-49e0-8b3f-f13181fe9b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b49da2a-d763-49e0-8b3f-f13181fe9b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90842e7-75ee-4e08-8e2a-d77c0a8677be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:19 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Volume c058077c-91b4-4169-8313-ffebaef2e53c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c058077c-91b4-4169-8313-ffebaef2e53c', 'volume_size': 1, 'snapshot_id': '445c6aa6-f46c-4097-88db-5eae7b8eaf9a'} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "cinder-quobyte-445c6aa6-f46c-4097-88db-5eae7b8eaf9a-c058077c-91b4-4169-8313-ffebaef2e53c" by "_create_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-quobyte-445c6aa6-f46c-4097-88db-5eae7b8eaf9a-c058077c-91b4-4169-8313-ffebaef2e53c" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Creating volume c058077c-91b4-4169-8313-ffebaef2e53c from snapshot 445c6aa6-f46c-4097-88db-5eae7b8eaf9a {{(pid=87217) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "cinder-quobyte-c058077c-91b4-4169-8313-ffebaef2e53c" by "_copy_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-quobyte-c058077c-91b4-4169-8313-ffebaef2e53c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] snapshot: 445c6aa6-f46c-4097-88db-5eae7b8eaf9a, volume: c058077c-91b4-4169-8313-ffebaef2e53c, {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[413721b6-c523-42de-b23f-e5c6379aa7e9]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:19 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a Jul 15 18:46:19 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:19 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a" returned: 0 in 0.337s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a76763ca-a066-4495-bf36-7c0d311933a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Creating direct copy from snapshot {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[735692a7-1b24-40a4-8f0b-fb5e2a75c307]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:19 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 Jul 15 18:46:19 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:20 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4" returned: 0 in 0.356s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:20 devstack cinder-volume[87217]: DEBUG cinder.utils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Path /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c not found in is_blk_device check {{(pid=87217) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:46:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:20 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c Jul 15 18:46:20 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:23 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c" returned: 0 in 3.840s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:23 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a78c1e-c6b3-4745-9410-f46836368d43]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:24 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 Jul 15 18:46:24 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:24 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4" returned: 0 in 0.503s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:24 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4, size 1024.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:46:24 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Converted 1024.00 MB image at 266.60 MB/s Jul 15 18:46:24 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c is being set with open permissions: ugo+rw Jul 15 18:46:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:24 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c Jul 15 18:46:24 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:24 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c" returned: 0 in 0.233s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-quobyte-c058077c-91b4-4169-8313-ffebaef2e53c" released by "_copy_volume_from_snapshot" :: held 5.350s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-quobyte-445c6aa6-f46c-4097-88db-5eae7b8eaf9a-c058077c-91b4-4169-8313-ffebaef2e53c" released by "_create_volume_from_snapshot" :: held 5.376s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.391s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90842e7-75ee-4e08-8e2a-d77c0a8677be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c058077c-91b4-4169-8313-ffebaef2e53c', 'volume_size': 1, 'snapshot_id': '445c6aa6-f46c-4097-88db-5eae7b8eaf9a'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8500b8f6-0b1f-4ff5-ae34-3e1561c467a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:24 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Volume volume-c058077c-91b4-4169-8313-ffebaef2e53c (c058077c-91b4-4169-8313-ffebaef2e53c): created successfully Jul 15 18:46:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8500b8f6-0b1f-4ff5-ae34-3e1561c467a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Flow 'volume_create_manager' (7704ef87-f311-4f04-ba97-ca449c1d30e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:24 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8c8135fd-23f9-440e-a133-629b8afa23d6 tempest-SnapshotDependencyTests-812924908 None] Created volume successfully. Jul 15 18:46:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "cinder-445c6aa6-f46c-4097-88db-5eae7b8eaf9a-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-445c6aa6-f46c-4097-88db-5eae7b8eaf9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "cinder-quobyte-a76763ca-a066-4495-bf36-7c0d311933a4" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-quobyte-a76763ca-a066-4495-bf36-7c0d311933a4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "cinder-quobyte-445c6aa6-f46c-4097-88db-5eae7b8eaf9a" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-quobyte-445c6aa6-f46c-4097-88db-5eae7b8eaf9a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Deleting offline snapshot 445c6aa6-f46c-4097-88db-5eae7b8eaf9a of volume a76763ca-a066-4495-bf36-7c0d311933a4 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:46:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] snapshot_file for this snap is: volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:46:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6609d19-54dc-4ccb-8f90-0c1e6764aebe]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:26 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a Jul 15 18:46:26 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:26 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a" returned: 0 in 0.365s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a76763ca-a066-4495-bf36-7c0d311933a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:46:26 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12152d1-ce9c-4aea-b2dd-6236be6bf03d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:26 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 Jul 15 18:46:26 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:26 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4" returned: 0 in 0.364s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:26 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a Jul 15 18:46:26 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:27 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a" returned: 0 in 0.323s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:27 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a Jul 15 18:46:27 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:27 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4.445c6aa6-f46c-4097-88db-5eae7b8eaf9a" returned: 0 in 0.245s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-quobyte-445c6aa6-f46c-4097-88db-5eae7b8eaf9a" released by "_delete_snapshot" :: held 1.385s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-quobyte-a76763ca-a066-4495-bf36-7c0d311933a4" released by "delete_snapshot" :: held 1.410s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:27 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Created reservations ['4d7768d5-4b44-4a6f-8b33-2c440a4343ea', '26870c38-272a-4847-b249-812970f563f0', '9f611e40-5351-49ce-a22d-a3e745f01de5', '39ccf250-c90d-4243-a4c8-02ef38f7c94c'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:27 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Delete snapshot completed successfully. Jul 15 18:46:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc954a7-d96d-45e0-84f5-7cec3a315856 tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-445c6aa6-f46c-4097-88db-5eae7b8eaf9a-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "cinder-a76763ca-a066-4495-bf36-7c0d311933a4-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-a76763ca-a066-4495-bf36-7c0d311933a4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "cinder-quobyte-a76763ca-a066-4495-bf36-7c0d311933a4" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-quobyte-a76763ca-a066-4495-bf36-7c0d311933a4" acquired by "delete_volume" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[567bd1cd-c174-44e7-9adf-22e0e03d163b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:28 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 Jul 15 18:46:28 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:28 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4" returned: 0 in 0.336s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:28 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4 Jul 15 18:46:28 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:28 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a76763ca-a066-4495-bf36-7c0d311933a4" returned: 0 in 0.242s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-quobyte-a76763ca-a066-4495-bf36-7c0d311933a4" released by "delete_volume" :: held 0.630s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Created reservations ['87b87153-d7bc-45fd-88d7-104bbe9d31bc', 'dfc72e4e-a373-45d1-b61b-e741c216867b', '4ad0d116-80b7-42aa-9562-5cee83da9eb3', 'ee50513b-1ca6-4f7a-9c0d-75402c715f91'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:28 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:46:28 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:29 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.288s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:29 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:29 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Deleted volume successfully. Jul 15 18:46:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0f9b34ed-1768-4123-8bb8-3bcbfbfcad0b tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-a76763ca-a066-4495-bf36-7c0d311933a4-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "cinder-c058077c-91b4-4169-8313-ffebaef2e53c-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-c058077c-91b4-4169-8313-ffebaef2e53c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "cinder-quobyte-c058077c-91b4-4169-8313-ffebaef2e53c" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-quobyte-c058077c-91b4-4169-8313-ffebaef2e53c" acquired by "delete_volume" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:29 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bee3e9-d604-41c5-a9fe-3a1215469289]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:29 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c Jul 15 18:46:29 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:29 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c" returned: 0 in 0.448s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:29 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c Jul 15 18:46:29 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:30 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c058077c-91b4-4169-8313-ffebaef2e53c" returned: 0 in 0.424s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-quobyte-c058077c-91b4-4169-8313-ffebaef2e53c" released by "delete_volume" :: held 0.924s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:30 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Created reservations ['6bc984d2-dfb6-4d25-9766-7e6660e10361', '52b475f9-9b3c-4bb9-990a-dee996529b64', '8c64bb67-1a5e-44df-81c0-676b00a867a9', '684b3d2b-f6b5-44cf-b6b1-c6c6cd6c0d7e'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:30 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:46:30 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:30 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.305s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:30 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Deleted volume successfully. Jul 15 18:46:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c4fdd4a2-c0fd-49e7-bbc9-81ab7492017c tempest-SnapshotDependencyTests-812924908 None] Lock "cinder-c058077c-91b4-4169-8313-ffebaef2e53c-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:31 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-1e1b8829-d53f-463f-8181-39b528dce57c tempest-TestShelveInstance-1394276225 None] Terminate volume connection completed successfully. Jul 15 18:46:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-1e1b8829-d53f-463f-8181-39b528dce57c tempest-TestShelveInstance-1394276225 None] Deleting attachment ed505af3-55b7-4818-843c-c301536494b6. {{(pid=87217) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 15 18:46:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Acquiring lock "cinder-e6ef1ead-cb14-4afa-995e-b777fa08978d-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Lock "cinder-e6ef1ead-cb14-4afa-995e-b777fa08978d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Acquiring lock "cinder-quobyte-e6ef1ead-cb14-4afa-995e-b777fa08978d" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Lock "cinder-quobyte-e6ef1ead-cb14-4afa-995e-b777fa08978d" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:31 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f94238-f947-491a-93af-d3ab6ee196d2]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:31 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d Jul 15 18:46:31 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:32 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d" returned: 0 in 0.390s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:32 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d Jul 15 18:46:32 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:32 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d" returned: 1 in 0.387s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:32 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d Jul 15 18:46:32 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:32 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:46:32 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:32 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e6ef1ead-cb14-4afa-995e-b777fa08978d" returned: 0 in 0.293s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Lock "cinder-quobyte-e6ef1ead-cb14-4afa-995e-b777fa08978d" released by "delete_volume" :: held 1.158s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG cinder.quota [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Created reservations ['70d2201a-46dd-4f29-8747-549928e1bce7', '3853b4f4-b294-48bd-affc-9f9061af95db', '8b51b20f-2745-47e4-8620-13c2fa9e6a90', '9dc881e7-f36a-417e-9919-d07c628ec570'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:33 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:46:33 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:33 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.318s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:46:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:46:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:46:33 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.286s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:33 devstack cinder-volume[87217]: DEBUG cinder.manager [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:33 devstack cinder-volume[87217]: INFO cinder.volume.manager [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Deleted volume successfully. Jul 15 18:46:33 devstack cinder-volume[87217]: DEBUG cinder.coordination [req-639f2625-f5d7-4105-a3e6-06af79f0c9a8 req-2431ad4d-7a1d-4a39-8333-3fbf893ae822 tempest-TestShelveInstance-1394276225 None] Lock "cinder-e6ef1ead-cb14-4afa-995e-b777fa08978d-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:42 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=33,cinder:UPDATE=34,cinder:DELETE=1,cinder:INSERT=7 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:46:43 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=38,cinder:SELECT=26,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Flow 'volume_create_manager' (ce25f66b-d0e6-47f0-aeff-bf3fd117a567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0392a2-a7ea-4d82-afaa-e7b7b0584080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0392a2-a7ea-4d82-afaa-e7b7b0584080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2078431621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73887ef7-56fa-4477-8790-959c857ce690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c94656ff37407ba9adbd78eb56280a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:45Z,use_quota=True,user_id='877b385e79cc4ee3a1a501f55745b894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0dc243b-71a4-4ed5-82c8-66bb8e75eb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0dc243b-71a4-4ed5-82c8-66bb8e75eb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe7fdca-3d7f-436f-a3d8-046a617a9af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe7fdca-3d7f-436f-a3d8-046a617a9af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73887ef7-56fa-4477-8790-959c857ce690', 'volume_name': 'volume-73887ef7-56fa-4477-8790-959c857ce690', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b215ea-5c43-491a-a19e-3d35d3c68c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b215ea-5c43-491a-a19e-3d35d3c68c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7474283f-6f68-4730-9504-5568b3471db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:44 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Volume 73887ef7-56fa-4477-8790-959c857ce690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73887ef7-56fa-4477-8790-959c857ce690', 'volume_size': 1} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2078431621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73887ef7-56fa-4477-8790-959c857ce690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c94656ff37407ba9adbd78eb56280a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:45Z,use_quota=True,user_id='877b385e79cc4ee3a1a501f55745b894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Creating volume 73887ef7-56fa-4477-8790-959c857ce690 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:46:44 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:46:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-73887ef7-56fa-4477-8790-959c857ce690 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:44 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-73887ef7-56fa-4477-8790-959c857ce690 1073741824 Jul 15 18:46:44 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Flow 'volume_create_manager' (a3e56669-df3d-4840-8215-f2158dd25cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b068ca-d02b-4bb4-b23f-842125ed1ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b068ca-d02b-4bb4-b23f-842125ed1ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1844451229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe71b7d-8bb2-48a3-b798-c1a645f83f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c94656ff37407ba9adbd78eb56280a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:45Z,use_quota=True,user_id='877b385e79cc4ee3a1a501f55745b894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4da4994-2b8a-41bd-af83-5f9d3961be43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4da4994-2b8a-41bd-af83-5f9d3961be43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d921786c-7c7d-4ec9-bbef-2a1ba2eb44ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d921786c-7c7d-4ec9-bbef-2a1ba2eb44ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe71b7d-8bb2-48a3-b798-c1a645f83f7e', 'volume_name': 'volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64026a0b-a3e1-47a2-b41d-75f00d97dc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64026a0b-a3e1-47a2-b41d-75f00d97dc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575e29be-a759-49f3-98fc-932908441fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:45 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Volume abe71b7d-8bb2-48a3-b798-c1a645f83f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e', 'volume_size': 1} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:45 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-73887ef7-56fa-4477-8790-959c857ce690 1073741824" returned: 0 in 0.492s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-73887ef7-56fa-4477-8790-959c857ce690 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:45 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-73887ef7-56fa-4477-8790-959c857ce690 Jul 15 18:46:45 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Flow 'volume_create_manager' (76a3863c-87d3-4366-b7a2-1d3e9b26d110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3204627e-ae2b-4d55-9d0f-ae0f52cc298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3204627e-ae2b-4d55-9d0f-ae0f52cc298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1859804248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ff0625-0f7b-45f4-8bcc-fb9686562415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c94656ff37407ba9adbd78eb56280a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:46Z,use_quota=True,user_id='877b385e79cc4ee3a1a501f55745b894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b73bb1b-06c8-4ff6-b15b-b6ba9003cdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b73bb1b-06c8-4ff6-b15b-b6ba9003cdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffac317-82fa-4ca5-a7d8-bb948f819f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffac317-82fa-4ca5-a7d8-bb948f819f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ff0625-0f7b-45f4-8bcc-fb9686562415', 'volume_name': 'volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eda3f77-6e59-404e-bb58-b49b276fb558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eda3f77-6e59-404e-bb58-b49b276fb558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4340cbd5-7eb5-43a8-822e-21d2fd66a62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:45 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Volume f7ff0625-0f7b-45f4-8bcc-fb9686562415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415', 'volume_size': 1} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:45 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-73887ef7-56fa-4477-8790-959c857ce690" returned: 0 in 0.276s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1844451229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe71b7d-8bb2-48a3-b798-c1a645f83f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c94656ff37407ba9adbd78eb56280a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:45Z,use_quota=True,user_id='877b385e79cc4ee3a1a501f55745b894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Creating volume abe71b7d-8bb2-48a3-b798-c1a645f83f7e {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:46:45 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7474283f-6f68-4730-9504-5568b3471db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73887ef7-56fa-4477-8790-959c857ce690', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:45 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e 1073741824 Jul 15 18:46:45 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac10d00a-138a-4f73-89f4-9b783f73b261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:45 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Volume volume-73887ef7-56fa-4477-8790-959c857ce690 (73887ef7-56fa-4477-8790-959c857ce690): created successfully Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac10d00a-138a-4f73-89f4-9b783f73b261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Flow 'volume_create_manager' (ce25f66b-d0e6-47f0-aeff-bf3fd117a567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:45 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1ac54faa-0898-4c3a-b43b-b7c51fd50158 tempest-CreateVolumesFromImageTest-14443908 None] Created volume successfully. Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Flow 'volume_create_manager' (f32b0fbb-67b3-4a8b-8920-105648aceff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c9ba25-0c82-4a16-8688-fe8f5cc87812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c9ba25-0c82-4a16-8688-fe8f5cc87812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-474042542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df87571-c7f2-4d7b-92e8-c31a41948f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c94656ff37407ba9adbd78eb56280a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:46Z,use_quota=True,user_id='877b385e79cc4ee3a1a501f55745b894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7755321b-9535-4756-a4e9-22c96db13748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7755321b-9535-4756-a4e9-22c96db13748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e30255-43bb-426b-8634-91927aaaba41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e30255-43bb-426b-8634-91927aaaba41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df87571-c7f2-4d7b-92e8-c31a41948f2a', 'volume_name': 'volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75edf6d5-16c9-4126-93d1-3f31f4f38551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75edf6d5-16c9-4126-93d1-3f31f4f38551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9408a6fb-ce6a-4d1c-9769-b251444eebf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:46 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Volume 5df87571-c7f2-4d7b-92e8-c31a41948f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a', 'volume_size': 1} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:46 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e 1073741824" returned: 0 in 0.544s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:46 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e Jul 15 18:46:46 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Flow 'volume_create_manager' (b8b086b1-b949-4fb0-ae7b-087bd76bf28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6aeda4-670f-4215-af04-15203f57b2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6aeda4-670f-4215-af04-15203f57b2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1517168692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb160d2-a602-409a-bbeb-801aaaf54d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c94656ff37407ba9adbd78eb56280a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:46Z,use_quota=True,user_id='877b385e79cc4ee3a1a501f55745b894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c90297-ef70-468c-99dd-c4e06c2b546c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c90297-ef70-468c-99dd-c4e06c2b546c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a57c78-e642-43d6-9ab0-0e0034c6f1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a57c78-e642-43d6-9ab0-0e0034c6f1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb160d2-a602-409a-bbeb-801aaaf54d9d', 'volume_name': 'volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f98889-4206-4374-9f3a-858275499ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f98889-4206-4374-9f3a-858275499ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb62f96-ce1b-462c-959f-e9d41c822e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:46 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Volume 7fb160d2-a602-409a-bbeb-801aaaf54d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d', 'volume_size': 1} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:46 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e" returned: 0 in 0.259s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.891s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1859804248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ff0625-0f7b-45f4-8bcc-fb9686562415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c94656ff37407ba9adbd78eb56280a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:46Z,use_quota=True,user_id='877b385e79cc4ee3a1a501f55745b894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Creating volume f7ff0625-0f7b-45f4-8bcc-fb9686562415 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:46:46 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:46 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415 1073741824 Jul 15 18:46:46 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575e29be-a759-49f3-98fc-932908441fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda3d80a-df5c-42a6-a5d0-7a17d0f59782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:46 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Volume volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e (abe71b7d-8bb2-48a3-b798-c1a645f83f7e): created successfully Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda3d80a-df5c-42a6-a5d0-7a17d0f59782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Flow 'volume_create_manager' (a3e56669-df3d-4840-8215-f2158dd25cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:46 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8362f336-7c00-4c33-b376-82420bda3b38 tempest-CreateVolumesFromImageTest-14443908 None] Created volume successfully. Jul 15 18:46:46 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415 1073741824" returned: 0 in 0.402s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:47 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415 Jul 15 18:46:47 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:47 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415" returned: 0 in 0.247s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.187s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-474042542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df87571-c7f2-4d7b-92e8-c31a41948f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c94656ff37407ba9adbd78eb56280a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:46Z,use_quota=True,user_id='877b385e79cc4ee3a1a501f55745b894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Creating volume 5df87571-c7f2-4d7b-92e8-c31a41948f2a {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:46:47 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4340cbd5-7eb5-43a8-822e-21d2fd66a62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7aa737-8919-459b-9dca-60cb788fc6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:47 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a 1073741824 Jul 15 18:46:47 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:47 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Volume volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415 (f7ff0625-0f7b-45f4-8bcc-fb9686562415): created successfully Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7aa737-8919-459b-9dca-60cb788fc6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Flow 'volume_create_manager' (76a3863c-87d3-4366-b7a2-1d3e9b26d110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:47 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-de4923ab-40b9-49c3-8581-d554bf8c0fcf tempest-CreateVolumesFromImageTest-14443908 None] Created volume successfully. Jul 15 18:46:47 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a 1073741824" returned: 0 in 0.414s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:47 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a Jul 15 18:46:47 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:47 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a" returned: 0 in 0.241s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.503s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1517168692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb160d2-a602-409a-bbeb-801aaaf54d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c94656ff37407ba9adbd78eb56280a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:46Z,use_quota=True,user_id='877b385e79cc4ee3a1a501f55745b894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Creating volume 7fb160d2-a602-409a-bbeb-801aaaf54d9d {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:46:47 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9408a6fb-ce6a-4d1c-9769-b251444eebf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:47 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d 1073741824 Jul 15 18:46:47 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4224cdcd-6d8e-44a9-b32e-676dd824551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:47 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Volume volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a (5df87571-c7f2-4d7b-92e8-c31a41948f2a): created successfully Jul 15 18:46:47 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4224cdcd-6d8e-44a9-b32e-676dd824551a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Flow 'volume_create_manager' (f32b0fbb-67b3-4a8b-8920-105648aceff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:48 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1018104c-cd9a-4883-9d43-70fa24b44d62 tempest-CreateVolumesFromImageTest-14443908 None] Created volume successfully. Jul 15 18:46:48 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d 1073741824" returned: 0 in 0.392s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:48 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d Jul 15 18:46:48 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:48 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d" returned: 0 in 0.251s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:46:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb62f96-ce1b-462c-959f-e9d41c822e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19c455a-dece-4a82-ae7c-9dc5bdd7c9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:48 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Volume volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d (7fb160d2-a602-409a-bbeb-801aaaf54d9d): created successfully Jul 15 18:46:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19c455a-dece-4a82-ae7c-9dc5bdd7c9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Flow 'volume_create_manager' (b8b086b1-b949-4fb0-ae7b-087bd76bf28a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:48 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f9a28b20-44fc-4d84-9468-5e0c27f2c4ba tempest-CreateVolumesFromImageTest-14443908 None] Created volume successfully. Jul 15 18:46:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "cinder-7fb160d2-a602-409a-bbeb-801aaaf54d9d-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-7fb160d2-a602-409a-bbeb-801aaaf54d9d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "cinder-quobyte-7fb160d2-a602-409a-bbeb-801aaaf54d9d" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-quobyte-7fb160d2-a602-409a-bbeb-801aaaf54d9d" acquired by "delete_volume" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:49 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc61d58-b89c-4092-a11e-b8a06252f17d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:49 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d Jul 15 18:46:49 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:50 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d" returned: 0 in 0.351s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:50 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d Jul 15 18:46:50 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:50 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7fb160d2-a602-409a-bbeb-801aaaf54d9d" returned: 0 in 0.254s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-quobyte-7fb160d2-a602-409a-bbeb-801aaaf54d9d" released by "delete_volume" :: held 0.643s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Created reservations ['d6f1c303-b79e-467f-91bd-d01f31667f68', '92ef7987-aa1f-4909-a484-b864d57d2387', 'fcb91895-92d1-4612-b02b-3d5436544e26', '240d3235-0d0d-4d05-9c6b-7d5f207c87b9'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:50 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:46:50 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:50 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.239s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:50 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Deleted volume successfully. Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7d902556-1808-4f16-ae62-8b8ba9a61f64 tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-7fb160d2-a602-409a-bbeb-801aaaf54d9d-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "cinder-5df87571-c7f2-4d7b-92e8-c31a41948f2a-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-5df87571-c7f2-4d7b-92e8-c31a41948f2a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "cinder-quobyte-5df87571-c7f2-4d7b-92e8-c31a41948f2a" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-quobyte-5df87571-c7f2-4d7b-92e8-c31a41948f2a" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b4d758-7158-4b25-b3e1-4ebdef037bc3]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:51 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a Jul 15 18:46:51 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:51 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a" returned: 0 in 0.351s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:51 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a Jul 15 18:46:51 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:51 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5df87571-c7f2-4d7b-92e8-c31a41948f2a" returned: 0 in 0.252s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-quobyte-5df87571-c7f2-4d7b-92e8-c31a41948f2a" released by "delete_volume" :: held 0.641s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Created reservations ['65c79323-d5cc-44e4-a081-10de25afb5c4', '01afca55-3d74-41da-9df0-7e70214e396c', 'ad80ba17-51b2-40ef-a6d1-9bfe882a5c3b', '97e245c0-4241-41cf-bec9-020a684e2784'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:51 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:46:51 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:51 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.246s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:51 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:51 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Deleted volume successfully. Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-05540ad4-b08a-4085-93cd-9dc2efd5cea2 tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-5df87571-c7f2-4d7b-92e8-c31a41948f2a-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "cinder-f7ff0625-0f7b-45f4-8bcc-fb9686562415-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-f7ff0625-0f7b-45f4-8bcc-fb9686562415-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "cinder-quobyte-f7ff0625-0f7b-45f4-8bcc-fb9686562415" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-quobyte-f7ff0625-0f7b-45f4-8bcc-fb9686562415" acquired by "delete_volume" :: waited 0.013s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c1aca8-3224-4a2e-b50c-f324023fdce7]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:52 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415 Jul 15 18:46:52 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:52 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415" returned: 0 in 0.352s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:52 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415 Jul 15 18:46:52 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:52 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f7ff0625-0f7b-45f4-8bcc-fb9686562415" returned: 0 in 0.247s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-quobyte-f7ff0625-0f7b-45f4-8bcc-fb9686562415" released by "delete_volume" :: held 0.637s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Created reservations ['0a37bdbc-bef8-4594-90cf-ed152950786c', 'e86c1c3d-5f9c-48d4-9dca-01c81c90ba50', 'c276d906-e168-4917-a0ec-2468db707be7', 'e23e1599-15e2-45c8-a344-c571188a424b'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:52 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:46:52 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:53 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.249s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:53 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Deleted volume successfully. Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4a39c12-b282-4fb5-8887-3ac1dd45111f tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-f7ff0625-0f7b-45f4-8bcc-fb9686562415-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "cinder-abe71b7d-8bb2-48a3-b798-c1a645f83f7e-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-abe71b7d-8bb2-48a3-b798-c1a645f83f7e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "cinder-quobyte-abe71b7d-8bb2-48a3-b798-c1a645f83f7e" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-quobyte-abe71b7d-8bb2-48a3-b798-c1a645f83f7e" acquired by "delete_volume" :: waited 0.012s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0e1e10-bc4e-4a71-8f28-c2f712afdf5d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:53 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e Jul 15 18:46:53 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:53 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e" returned: 0 in 0.355s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:53 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e Jul 15 18:46:53 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:53 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-abe71b7d-8bb2-48a3-b798-c1a645f83f7e" returned: 0 in 0.247s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-quobyte-abe71b7d-8bb2-48a3-b798-c1a645f83f7e" released by "delete_volume" :: held 0.637s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:53 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Created reservations ['824737e2-7b95-4648-8746-c2e4c2468e3e', '8881fea9-4e80-4056-812d-c8b8bbb0ffa8', '8971757d-dc41-4207-922e-eac1ebd4deae', 'd5bac37d-f11d-43d8-83bc-7f124e88da02'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:54 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:46:54 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:54 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.254s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Deleted volume successfully. Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e155b63b-0688-433e-adc2-9719f159edf4 tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-abe71b7d-8bb2-48a3-b798-c1a645f83f7e-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "cinder-73887ef7-56fa-4477-8790-959c857ce690-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-73887ef7-56fa-4477-8790-959c857ce690-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "cinder-quobyte-73887ef7-56fa-4477-8790-959c857ce690" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-quobyte-73887ef7-56fa-4477-8790-959c857ce690" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[515b8b58-dabf-4373-b24f-d9a3420dd35f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-73887ef7-56fa-4477-8790-959c857ce690 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:54 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-73887ef7-56fa-4477-8790-959c857ce690 Jul 15 18:46:54 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:54 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-73887ef7-56fa-4477-8790-959c857ce690" returned: 0 in 0.371s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-73887ef7-56fa-4477-8790-959c857ce690 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:54 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-73887ef7-56fa-4477-8790-959c857ce690 Jul 15 18:46:54 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:55 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-73887ef7-56fa-4477-8790-959c857ce690" returned: 0 in 0.246s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-quobyte-73887ef7-56fa-4477-8790-959c857ce690" released by "delete_volume" :: held 0.656s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:55 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Created reservations ['bf6d6f8f-f054-4dae-8de3-32c850949c20', 'df461b8b-15cb-4f59-b3a7-254297252439', 'cff21edc-8bad-424a-a97e-30c7815d86fc', '3bf53d3d-35d2-4b37-8e2e-f7d821cf4ab5'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:46:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:55 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:46:55 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:55 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.244s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:55 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:46:55 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Deleted volume successfully. Jul 15 18:46:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-73dcedf0-4bd4-4f77-bb75-9b85d8941d4a tempest-CreateVolumesFromImageTest-14443908 None] Lock "cinder-73887ef7-56fa-4477-8790-959c857ce690-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Flow 'volume_create_manager' (b244262f-5684-4abb-9b1c-a3edb96d89c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8eb4c70-9ff5-4356-9cdd-b3428b227fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8eb4c70-9ff5-4356-9cdd-b3428b227fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-405967015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74adab6b-b023-4a60-ac7e-9bb45294db8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b3ab0f92c4449813d79b337155a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:58Z,use_quota=True,user_id='d313c2507fce4cab96327fc276dca4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9601ac84-b643-4570-ad01-de3cbe5901f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9601ac84-b643-4570-ad01-de3cbe5901f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21cb4dd2-59f6-4c16-8b7d-1fb104a9c8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21cb4dd2-59f6-4c16-8b7d-1fb104a9c8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74adab6b-b023-4a60-ac7e-9bb45294db8d', 'volume_name': 'volume-74adab6b-b023-4a60-ac7e-9bb45294db8d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f29191-c4e7-4109-aa48-b2dc76893296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f29191-c4e7-4109-aa48-b2dc76893296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd5eda7-60d8-4a16-9c3e-3b2144ff8699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:58 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume 74adab6b-b023-4a60-ac7e-9bb45294db8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74adab6b-b023-4a60-ac7e-9bb45294db8d', 'volume_size': 1} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-405967015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74adab6b-b023-4a60-ac7e-9bb45294db8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b3ab0f92c4449813d79b337155a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:46:58Z,use_quota=True,user_id='d313c2507fce4cab96327fc276dca4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Creating volume 74adab6b-b023-4a60-ac7e-9bb45294db8d {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:46:58 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-74adab6b-b023-4a60-ac7e-9bb45294db8d 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:58 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-74adab6b-b023-4a60-ac7e-9bb45294db8d 1073741824 Jul 15 18:46:58 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:58 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-74adab6b-b023-4a60-ac7e-9bb45294db8d 1073741824" returned: 0 in 0.416s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-74adab6b-b023-4a60-ac7e-9bb45294db8d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:58 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-74adab6b-b023-4a60-ac7e-9bb45294db8d Jul 15 18:46:58 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:46:59 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-74adab6b-b023-4a60-ac7e-9bb45294db8d" returned: 0 in 0.257s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd5eda7-60d8-4a16-9c3e-3b2144ff8699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74adab6b-b023-4a60-ac7e-9bb45294db8d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcd2ce2-4ca6-424b-aa80-76245f2a562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:59 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume volume-74adab6b-b023-4a60-ac7e-9bb45294db8d (74adab6b-b023-4a60-ac7e-9bb45294db8d): created successfully Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcd2ce2-4ca6-424b-aa80-76245f2a562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Flow 'volume_create_manager' (b244262f-5684-4abb-9b1c-a3edb96d89c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:59 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c39bc1a2-8111-444b-819b-1d3782c3581b tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Created volume successfully. Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Flow 'volume_create_manager' (eb2f81f4-2b91-43e3-af4d-6d8caa37cb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f42f059-f858-4b84-b56a-25b046e4f1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f42f059-f858-4b84-b56a-25b046e4f1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1740230199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3ab24c-3478-4af4-bf7f-b496bc105810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b3ab0f92c4449813d79b337155a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:00Z,use_quota=True,user_id='d313c2507fce4cab96327fc276dca4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f3fb71-fef2-480e-b032-db2c9b5b1f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f3fb71-fef2-480e-b032-db2c9b5b1f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c767769-5ccc-4106-abd9-cd892a744712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c767769-5ccc-4106-abd9-cd892a744712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b3ab24c-3478-4af4-bf7f-b496bc105810', 'volume_name': 'volume-2b3ab24c-3478-4af4-bf7f-b496bc105810', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842a269c-7347-4ef8-85e5-a8a903b6a7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842a269c-7347-4ef8-85e5-a8a903b6a7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27d020e-6590-4887-8664-52a80f68b237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:46:59 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume 2b3ab24c-3478-4af4-bf7f-b496bc105810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b3ab24c-3478-4af4-bf7f-b496bc105810', 'volume_size': 1} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1740230199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3ab24c-3478-4af4-bf7f-b496bc105810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b3ab0f92c4449813d79b337155a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:00Z,use_quota=True,user_id='d313c2507fce4cab96327fc276dca4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Creating volume 2b3ab24c-3478-4af4-bf7f-b496bc105810 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:46:59 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:46:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b3ab24c-3478-4af4-bf7f-b496bc105810 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:46:59 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b3ab24c-3478-4af4-bf7f-b496bc105810 1073741824 Jul 15 18:46:59 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Flow 'volume_create_manager' (eb7e6b13-36c7-41ed-b675-3f9614051057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b3f503-1410-4bd9-b653-68f83ff8e447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b3f503-1410-4bd9-b653-68f83ff8e447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009918150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7945a532-16ae-465a-9d47-22ddc5015b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b3ab0f92c4449813d79b337155a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:00Z,use_quota=True,user_id='d313c2507fce4cab96327fc276dca4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3456fb6-5b5a-4d69-8cd7-98d0cf97b307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3456fb6-5b5a-4d69-8cd7-98d0cf97b307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926a960a-99de-496a-b2ac-d2425cd5b2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926a960a-99de-496a-b2ac-d2425cd5b2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7945a532-16ae-465a-9d47-22ddc5015b6a', 'volume_name': 'volume-7945a532-16ae-465a-9d47-22ddc5015b6a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08536851-f3f7-42d9-84c6-fc0a2b19fd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08536851-f3f7-42d9-84c6-fc0a2b19fd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f97035-9f5c-4b04-b513-07d2c857e249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:00 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume 7945a532-16ae-465a-9d47-22ddc5015b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7945a532-16ae-465a-9d47-22ddc5015b6a', 'volume_size': 1} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:00 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b3ab24c-3478-4af4-bf7f-b496bc105810 1073741824" returned: 0 in 0.491s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b3ab24c-3478-4af4-bf7f-b496bc105810 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:00 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b3ab24c-3478-4af4-bf7f-b496bc105810 Jul 15 18:47:00 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Flow 'volume_create_manager' (b27a8bba-b4ee-4910-a0ee-45ed41369622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab981480-fa24-4f2d-81f7-4346ef47f0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab981480-fa24-4f2d-81f7-4346ef47f0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2078895238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3eb3e14-0ade-4681-9cae-2b3aaf4333d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b3ab0f92c4449813d79b337155a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:00Z,use_quota=True,user_id='d313c2507fce4cab96327fc276dca4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47580eb-77cd-4715-bf09-cad2aee0fb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47580eb-77cd-4715-bf09-cad2aee0fb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc2565b-6a46-4844-befb-a23ae467507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc2565b-6a46-4844-befb-a23ae467507d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3eb3e14-0ade-4681-9cae-2b3aaf4333d6', 'volume_name': 'volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466d5fa3-b915-4d86-8ca3-8d92b0aac757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466d5fa3-b915-4d86-8ca3-8d92b0aac757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5783d2da-9901-400b-b825-de4e7addfa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:00 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume f3eb3e14-0ade-4681-9cae-2b3aaf4333d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6', 'volume_size': 1} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:00 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b3ab24c-3478-4af4-bf7f-b496bc105810" returned: 0 in 0.283s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.432s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009918150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7945a532-16ae-465a-9d47-22ddc5015b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b3ab0f92c4449813d79b337155a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:00Z,use_quota=True,user_id='d313c2507fce4cab96327fc276dca4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Creating volume 7945a532-16ae-465a-9d47-22ddc5015b6a {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:00 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7945a532-16ae-465a-9d47-22ddc5015b6a 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:00 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7945a532-16ae-465a-9d47-22ddc5015b6a 1073741824 Jul 15 18:47:00 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27d020e-6590-4887-8664-52a80f68b237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b3ab24c-3478-4af4-bf7f-b496bc105810', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb691dd-52fc-4ecf-8181-d9e661e8a6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:00 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume volume-2b3ab24c-3478-4af4-bf7f-b496bc105810 (2b3ab24c-3478-4af4-bf7f-b496bc105810): created successfully Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb691dd-52fc-4ecf-8181-d9e661e8a6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Flow 'volume_create_manager' (eb2f81f4-2b91-43e3-af4d-6d8caa37cb36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:00 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-42efc08d-f82e-45c2-9d3b-b13e54747361 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Created volume successfully. Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Flow 'volume_create_manager' (f9b89345-f96a-4dff-b2bc-7223fd738867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112dc61c-32c7-4186-850e-73004fb24c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112dc61c-32c7-4186-850e-73004fb24c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1636735561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac5ddb9-2cf1-467e-a313-ee27f691d79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b3ab0f92c4449813d79b337155a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:01Z,use_quota=True,user_id='d313c2507fce4cab96327fc276dca4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b739fb1-f4b5-4ca0-829e-3f41f997527b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b739fb1-f4b5-4ca0-829e-3f41f997527b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45071b31-def4-48f3-9f9f-56f450613fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45071b31-def4-48f3-9f9f-56f450613fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac5ddb9-2cf1-467e-a313-ee27f691d79a', 'volume_name': 'volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7491335c-a777-4beb-a6ce-2f5af61ea7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7491335c-a777-4beb-a6ce-2f5af61ea7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160bfb77-a00e-454c-b7a4-bbd0fcdba679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:01 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume eac5ddb9-2cf1-467e-a313-ee27f691d79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a', 'volume_size': 1} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:01 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7945a532-16ae-465a-9d47-22ddc5015b6a 1073741824" returned: 0 in 0.519s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7945a532-16ae-465a-9d47-22ddc5015b6a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:01 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7945a532-16ae-465a-9d47-22ddc5015b6a Jul 15 18:47:01 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Flow 'volume_create_manager' (d8e099b0-fbc1-492a-9f34-71203db62d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac77a7f-8651-4c09-a6e3-d53b8ab7a6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac77a7f-8651-4c09-a6e3-d53b8ab7a6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1362640136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dcc5063-26ea-4762-a3a3-b1c6600a28d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b3ab0f92c4449813d79b337155a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:01Z,use_quota=True,user_id='d313c2507fce4cab96327fc276dca4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ce3064-e5b6-42f8-b093-5292d5d996f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ce3064-e5b6-42f8-b093-5292d5d996f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53788b18-0cdc-45f8-938f-52fdd67b9a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53788b18-0cdc-45f8-938f-52fdd67b9a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dcc5063-26ea-4762-a3a3-b1c6600a28d4', 'volume_name': 'volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295d9ffa-c6a9-4b65-9a21-6f394591ed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295d9ffa-c6a9-4b65-9a21-6f394591ed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81242719-3011-4ec5-834c-ede95526300a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:01 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume 8dcc5063-26ea-4762-a3a3-b1c6600a28d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4', 'volume_size': 1} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:01 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7945a532-16ae-465a-9d47-22ddc5015b6a" returned: 0 in 0.240s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2078895238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3eb3e14-0ade-4681-9cae-2b3aaf4333d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b3ab0f92c4449813d79b337155a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:00Z,use_quota=True,user_id='d313c2507fce4cab96327fc276dca4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Creating volume f3eb3e14-0ade-4681-9cae-2b3aaf4333d6 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:01 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f97035-9f5c-4b04-b513-07d2c857e249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7945a532-16ae-465a-9d47-22ddc5015b6a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:01 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6 1073741824 Jul 15 18:47:01 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ef6568-af5b-4e98-9041-24ab8ce82d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:01 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume volume-7945a532-16ae-465a-9d47-22ddc5015b6a (7945a532-16ae-465a-9d47-22ddc5015b6a): created successfully Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ef6568-af5b-4e98-9041-24ab8ce82d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Flow 'volume_create_manager' (eb7e6b13-36c7-41ed-b675-3f9614051057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:01 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f3e3f123-024b-4242-a710-a69bd9076ad0 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Created volume successfully. Jul 15 18:47:01 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6 1073741824" returned: 0 in 0.430s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:02 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6 Jul 15 18:47:02 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:02 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6" returned: 0 in 0.244s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.208s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1636735561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac5ddb9-2cf1-467e-a313-ee27f691d79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b3ab0f92c4449813d79b337155a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:01Z,use_quota=True,user_id='d313c2507fce4cab96327fc276dca4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Creating volume eac5ddb9-2cf1-467e-a313-ee27f691d79a {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:02 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5783d2da-9901-400b-b825-de4e7addfa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:02 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a 1073741824 Jul 15 18:47:02 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a367253-1ed9-4591-8b85-04ee2e11525b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:02 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6 (f3eb3e14-0ade-4681-9cae-2b3aaf4333d6): created successfully Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a367253-1ed9-4591-8b85-04ee2e11525b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Flow 'volume_create_manager' (b27a8bba-b4ee-4910-a0ee-45ed41369622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:02 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-cb8654c8-afa2-48ce-a4cc-e8ec9ccdbf27 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Created volume successfully. Jul 15 18:47:02 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a 1073741824" returned: 0 in 0.422s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:02 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a Jul 15 18:47:02 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:02 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a" returned: 0 in 0.260s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1362640136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dcc5063-26ea-4762-a3a3-b1c6600a28d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d73b3ab0f92c4449813d79b337155a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:01Z,use_quota=True,user_id='d313c2507fce4cab96327fc276dca4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Creating volume 8dcc5063-26ea-4762-a3a3-b1c6600a28d4 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:02 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:02 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160bfb77-a00e-454c-b7a4-bbd0fcdba679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:03 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4 1073741824 Jul 15 18:47:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68212982-f28b-4352-a196-63b74be0e465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:03 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:03 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a (eac5ddb9-2cf1-467e-a313-ee27f691d79a): created successfully Jul 15 18:47:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68212982-f28b-4352-a196-63b74be0e465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Flow 'volume_create_manager' (f9b89345-f96a-4dff-b2bc-7223fd738867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-911adad2-72f4-4510-8ccb-bef98412561f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Created volume successfully. Jul 15 18:47:03 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4 1073741824" returned: 0 in 0.420s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:03 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4 Jul 15 18:47:03 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:03 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4" returned: 0 in 0.276s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81242719-3011-4ec5-834c-ede95526300a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56a5535-79b3-464d-bbc8-f9fd29a3acf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:03 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Volume volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4 (8dcc5063-26ea-4762-a3a3-b1c6600a28d4): created successfully Jul 15 18:47:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56a5535-79b3-464d-bbc8-f9fd29a3acf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Flow 'volume_create_manager' (d8e099b0-fbc1-492a-9f34-71203db62d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4a54acb2-f3b9-4d42-961e-9459db6a256f tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Created volume successfully. Jul 15 18:47:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "cinder-8dcc5063-26ea-4762-a3a3-b1c6600a28d4-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-8dcc5063-26ea-4762-a3a3-b1c6600a28d4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "cinder-quobyte-8dcc5063-26ea-4762-a3a3-b1c6600a28d4" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-quobyte-8dcc5063-26ea-4762-a3a3-b1c6600a28d4" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:04 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5089d8a-a289-44f9-990c-f4953e2319b3]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:04 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4 Jul 15 18:47:04 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:05 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4" returned: 0 in 0.354s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:05 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4 Jul 15 18:47:05 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:05 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-8dcc5063-26ea-4762-a3a3-b1c6600a28d4" returned: 0 in 0.259s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-quobyte-8dcc5063-26ea-4762-a3a3-b1c6600a28d4" released by "delete_volume" :: held 0.656s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Created reservations ['ec1ce820-d59f-4c7f-9632-3d68fa422623', '1ac22999-bf3c-4a99-9714-b56f7ade1a36', '0c9af850-6a8c-4fc0-a380-0302ba2960d2', '528420df-a387-4641-9964-439bd8051c8e'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:05 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:05 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:05 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.287s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:05 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Deleted volume successfully. Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6b06bbb8-4429-4fe8-807f-c1ffb58c6692 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-8dcc5063-26ea-4762-a3a3-b1c6600a28d4-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "cinder-eac5ddb9-2cf1-467e-a313-ee27f691d79a-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-eac5ddb9-2cf1-467e-a313-ee27f691d79a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "cinder-quobyte-eac5ddb9-2cf1-467e-a313-ee27f691d79a" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-quobyte-eac5ddb9-2cf1-467e-a313-ee27f691d79a" acquired by "delete_volume" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a7f28e-a74f-435d-a99e-3c557be6e3ad]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:06 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a Jul 15 18:47:06 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:06 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a" returned: 0 in 0.364s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:06 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a Jul 15 18:47:06 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:06 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-eac5ddb9-2cf1-467e-a313-ee27f691d79a" returned: 0 in 0.243s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-quobyte-eac5ddb9-2cf1-467e-a313-ee27f691d79a" released by "delete_volume" :: held 0.643s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Created reservations ['251a4358-e461-4a64-bbe2-9aba377d950b', '1a632445-6e3e-4e7b-8b03-3afee02bcf51', '08cb0473-0b79-4900-963e-0db977836668', 'bd314af0-2026-4ef5-bca1-141b3aed1cdb'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:06 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:06 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:06 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.243s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:06 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:06 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Deleted volume successfully. Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-156814a0-986a-436e-9e87-35b05e268200 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-eac5ddb9-2cf1-467e-a313-ee27f691d79a-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "cinder-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "cinder-quobyte-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-quobyte-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6" acquired by "delete_volume" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b199fe9-5aea-41a1-836e-b84ef9fefe25]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:07 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6 Jul 15 18:47:07 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:07 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6" returned: 0 in 0.349s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:07 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6 Jul 15 18:47:07 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:07 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6" returned: 0 in 0.250s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-quobyte-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6" released by "delete_volume" :: held 0.637s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Created reservations ['4b028b69-9dd9-4520-8d3c-b7df9d32a844', 'e57ecd1d-f47a-495a-b101-84545dd91943', '62bb734e-8e19-4d6e-8162-b18b7e111bbd', 'e3c5670a-daee-4a8d-9caf-00daea1e480f'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:07 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:07 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:08 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.245s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:08 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Deleted volume successfully. Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f51f5387-189b-4744-8e73-884d2a627d92 tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-f3eb3e14-0ade-4681-9cae-2b3aaf4333d6-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "cinder-7945a532-16ae-465a-9d47-22ddc5015b6a-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-7945a532-16ae-465a-9d47-22ddc5015b6a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "cinder-quobyte-7945a532-16ae-465a-9d47-22ddc5015b6a" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-quobyte-7945a532-16ae-465a-9d47-22ddc5015b6a" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a0b10f-32df-4bf9-b5ef-68ee501b1025]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7945a532-16ae-465a-9d47-22ddc5015b6a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:08 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7945a532-16ae-465a-9d47-22ddc5015b6a Jul 15 18:47:08 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:08 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7945a532-16ae-465a-9d47-22ddc5015b6a" returned: 0 in 0.358s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7945a532-16ae-465a-9d47-22ddc5015b6a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:08 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7945a532-16ae-465a-9d47-22ddc5015b6a Jul 15 18:47:08 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:08 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-7945a532-16ae-465a-9d47-22ddc5015b6a" returned: 0 in 0.254s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-quobyte-7945a532-16ae-465a-9d47-22ddc5015b6a" released by "delete_volume" :: held 0.646s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:08 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Created reservations ['9fe0784a-d1ee-4470-b184-f354b5461e28', '66aa08db-c192-4e90-b72d-2eb6cadcd4d8', '049bbf15-f0a2-46d4-8a5b-e83c32122cba', '786cd601-b1bb-4200-b8b5-5e03fd8cf918'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:09 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:09 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:09 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.246s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:09 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Deleted volume successfully. Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4ac613ce-088b-40ef-b77a-51252c1798fe tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-7945a532-16ae-465a-9d47-22ddc5015b6a-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "cinder-2b3ab24c-3478-4af4-bf7f-b496bc105810-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-2b3ab24c-3478-4af4-bf7f-b496bc105810-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "cinder-quobyte-2b3ab24c-3478-4af4-bf7f-b496bc105810" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-quobyte-2b3ab24c-3478-4af4-bf7f-b496bc105810" acquired by "delete_volume" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[18368717-3da4-46cf-9961-c140e6f34730]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b3ab24c-3478-4af4-bf7f-b496bc105810 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:09 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b3ab24c-3478-4af4-bf7f-b496bc105810 Jul 15 18:47:09 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:09 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b3ab24c-3478-4af4-bf7f-b496bc105810" returned: 0 in 0.354s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b3ab24c-3478-4af4-bf7f-b496bc105810 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:09 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b3ab24c-3478-4af4-bf7f-b496bc105810 Jul 15 18:47:09 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:10 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-2b3ab24c-3478-4af4-bf7f-b496bc105810" returned: 0 in 0.245s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-quobyte-2b3ab24c-3478-4af4-bf7f-b496bc105810" released by "delete_volume" :: held 0.635s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Created reservations ['53e7f204-6b10-4bf0-a7a0-ddbdb897a0c0', '18315c0d-8e18-4b5b-a570-9c69b6663400', 'a5ec03e2-9513-418f-a48e-91a646fc571b', 'ab46ac3f-69aa-4319-b56d-e2f653f14ae3'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:10 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:10 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:10 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.250s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:10 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Deleted volume successfully. Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d4006854-c633-4e01-b8d1-6b12f1cbdcfc tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-2b3ab24c-3478-4af4-bf7f-b496bc105810-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "cinder-74adab6b-b023-4a60-ac7e-9bb45294db8d-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-74adab6b-b023-4a60-ac7e-9bb45294db8d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "cinder-quobyte-74adab6b-b023-4a60-ac7e-9bb45294db8d" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-quobyte-74adab6b-b023-4a60-ac7e-9bb45294db8d" acquired by "delete_volume" :: waited 0.013s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35fec15-b38c-4257-808f-120452c0f89c]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-74adab6b-b023-4a60-ac7e-9bb45294db8d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:10 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-74adab6b-b023-4a60-ac7e-9bb45294db8d Jul 15 18:47:10 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:10 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-74adab6b-b023-4a60-ac7e-9bb45294db8d" returned: 0 in 0.347s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-74adab6b-b023-4a60-ac7e-9bb45294db8d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:11 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-74adab6b-b023-4a60-ac7e-9bb45294db8d Jul 15 18:47:11 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:11 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-74adab6b-b023-4a60-ac7e-9bb45294db8d" returned: 0 in 0.248s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-quobyte-74adab6b-b023-4a60-ac7e-9bb45294db8d" released by "delete_volume" :: held 0.633s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:11 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Created reservations ['5d0aa999-5da1-4263-bcbe-e14609aacae9', '8c15f742-b83b-4d22-a100-f1cd777b9d48', '20ae5543-8f8e-4fdd-9f8c-be358c9648a8', '54eae427-e0b2-4311-8bcc-e518ddde79a3'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:11 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:11 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:11 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.240s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:11 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:11 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Deleted volume successfully. Jul 15 18:47:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-342f669a-22f8-481d-b690-78083a9d640e tempest-CreateVolumesFromSourceVolumeTest-867448007 None] Lock "cinder-74adab6b-b023-4a60-ac7e-9bb45294db8d-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:21 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=132,cinder:SELECT=74,cinder:INSERT=29,cinder:DELETE=12 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:47:21 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=80,cinder:UPDATE=110,cinder:DELETE=10,cinder:INSERT=26 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Flow 'volume_create_manager' (3956d23f-ce9a-44b5-b3f5-5632beb015c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339ffaf1-aed7-4a09-8dc0-066da5527d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339ffaf1-aed7-4a09-8dc0-066da5527d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-662175912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8a9cad-a114-4744-b162-64e773f1e1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464967d491c24c8689413172760473b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:28Z,use_quota=True,user_id='0e5bfe1fa1724954842907d339d46a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65009f08-04ac-4bbc-ba46-c4d98834760a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65009f08-04ac-4bbc-ba46-c4d98834760a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814429ea-e68e-4720-8cb4-15a8f10a1489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814429ea-e68e-4720-8cb4-15a8f10a1489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8a9cad-a114-4744-b162-64e773f1e1ae', 'volume_name': 'volume-0f8a9cad-a114-4744-b162-64e773f1e1ae', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc49113-c8cf-44db-87dd-55c7dc327684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc49113-c8cf-44db-87dd-55c7dc327684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fe897e-8c37-4121-9eb4-b3d6a7a2dded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:27 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Volume 0f8a9cad-a114-4744-b162-64e773f1e1ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8a9cad-a114-4744-b162-64e773f1e1ae', 'volume_size': 1} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-662175912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8a9cad-a114-4744-b162-64e773f1e1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464967d491c24c8689413172760473b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:28Z,use_quota=True,user_id='0e5bfe1fa1724954842907d339d46a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Creating volume 0f8a9cad-a114-4744-b162-64e773f1e1ae {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:27 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:27 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae 1073741824 Jul 15 18:47:27 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Flow 'volume_create_manager' (06d44f0f-a4e9-4f1e-a1de-15879341c5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a61b712-6716-4b59-a329-0a098bdac4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a61b712-6716-4b59-a329-0a098bdac4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943013893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a01a59-aa17-4420-8173-5708e57bb30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3307d0c4dd14c2f8ec8edff795fef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:28Z,use_quota=True,user_id='01416f95a0bf4b97961e930b39ede57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de914e5-d196-4d73-a2f3-bae19c8d7c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de914e5-d196-4d73-a2f3-bae19c8d7c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbca221-0e2f-417f-ad87-5c5686db5a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbca221-0e2f-417f-ad87-5c5686db5a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a01a59-aa17-4420-8173-5708e57bb30b', 'volume_name': 'volume-77a01a59-aa17-4420-8173-5708e57bb30b', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0086249a-688c-4f9d-afab-de6d65664898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0086249a-688c-4f9d-afab-de6d65664898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334c38fb-2674-4b1f-891a-5745d5871716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:27 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume 77a01a59-aa17-4420-8173-5708e57bb30b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a01a59-aa17-4420-8173-5708e57bb30b', 'volume_size': 1} Jul 15 18:47:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Flow 'volume_create_manager' (965e42d3-7961-4a28-84b2-4f70f9309270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b73090-a50f-4311-a601-e9dede629842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b73090-a50f-4311-a601-e9dede629842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1819340604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d5e9742-1116-4986-847f-361f42f217bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60000e9f88bc48299f50451b5decf043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:28Z,use_quota=True,user_id='88b230f3578e474ea9e9b137341efbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77889f09-87c8-4978-bf91-59b358bd6da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77889f09-87c8-4978-bf91-59b358bd6da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e87f16-055f-4eea-99be-c530c6bdbb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e87f16-055f-4eea-99be-c530c6bdbb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d5e9742-1116-4986-847f-361f42f217bf', 'volume_name': 'volume-4d5e9742-1116-4986-847f-361f42f217bf', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c4d8cd-df47-4253-a6e8-14766661af5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c4d8cd-df47-4253-a6e8-14766661af5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cfca78-2768-4292-93f5-271b1e14db32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:28 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Volume 4d5e9742-1116-4986-847f-361f42f217bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d5e9742-1116-4986-847f-361f42f217bf', 'volume_size': 1} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:28 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae 1073741824" returned: 0 in 0.598s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:28 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae Jul 15 18:47:28 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Flow 'volume_create_manager' (88ba34f4-3167-4bf3-8786-86d17f1fbfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e024f2-cfdb-4960-b175-b8f04e6a82f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e024f2-cfdb-4960-b175-b8f04e6a82f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1528460784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab16c47-ea32-4b88-a951-4a27cf65fe60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60000e9f88bc48299f50451b5decf043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:29Z,use_quota=True,user_id='88b230f3578e474ea9e9b137341efbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2b81ba-5b40-4f13-9b40-5a580aaed6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2b81ba-5b40-4f13-9b40-5a580aaed6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1418c64c-7034-4950-8a34-86c9b4a0c036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1418c64c-7034-4950-8a34-86c9b4a0c036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab16c47-ea32-4b88-a951-4a27cf65fe60', 'volume_name': 'volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77f2822-5198-4563-a724-df0ad56e8874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77f2822-5198-4563-a724-df0ad56e8874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e3d9f0-f05f-497a-8a30-31ecfb5e4a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:28 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Volume 9ab16c47-ea32-4b88-a951-4a27cf65fe60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60', 'volume_size': 1} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:28 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae" returned: 0 in 0.421s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.910s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943013893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a01a59-aa17-4420-8173-5708e57bb30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3307d0c4dd14c2f8ec8edff795fef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:28Z,use_quota=True,user_id='01416f95a0bf4b97961e930b39ede57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Creating volume 77a01a59-aa17-4420-8173-5708e57bb30b {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:28 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:28 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b 1073741824 Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fe897e-8c37-4121-9eb4-b3d6a7a2dded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8a9cad-a114-4744-b162-64e773f1e1ae', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:28 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27db623-3792-41c0-a3e8-034c65978ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:28 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Volume volume-0f8a9cad-a114-4744-b162-64e773f1e1ae (0f8a9cad-a114-4744-b162-64e773f1e1ae): created successfully Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27db623-3792-41c0-a3e8-034c65978ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:28 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Flow 'volume_create_manager' (3956d23f-ce9a-44b5-b3f5-5632beb015c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:28 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c053ebd3-be69-49ee-b964-6c4ad9f11477 tempest-VolumeDependencyTests-111787306 None] Created volume successfully. Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Flow 'volume_create_manager' (6cfc3b41-dee6-49a2-aa2f-85ebd3172504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a477880e-2df8-4dab-ae51-ee1e14ff23a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a477880e-2df8-4dab-ae51-ee1e14ff23a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-304257256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8386940-c9f7-4104-8680-568c4448ebd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60000e9f88bc48299f50451b5decf043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:29Z,use_quota=True,user_id='88b230f3578e474ea9e9b137341efbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a8d71b-c9c7-4103-8e60-6ba1f651d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a8d71b-c9c7-4103-8e60-6ba1f651d900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203368c8-52dc-4f5f-8b91-08a2d4f9c3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203368c8-52dc-4f5f-8b91-08a2d4f9c3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8386940-c9f7-4104-8680-568c4448ebd9', 'volume_name': 'volume-c8386940-c9f7-4104-8680-568c4448ebd9', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d14e7a-0dd9-430b-943a-50c90b069460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d14e7a-0dd9-430b-943a-50c90b069460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0594df84-620e-494c-aa57-202e9e5a3d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:29 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Volume c8386940-c9f7-4104-8680-568c4448ebd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8386940-c9f7-4104-8680-568c4448ebd9', 'volume_size': 1} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Flow 'volume_create_manager' (594704b7-2ae0-4867-b53d-4a6ee98e7c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684e5772-df25-486e-84f1-a19098c3b6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:29 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b 1073741824" returned: 0 in 0.674s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684e5772-df25-486e-84f1-a19098c3b6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1288824360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92abeffd-2ddc-4d34-a1ad-abb43c60c126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60000e9f88bc48299f50451b5decf043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:29Z,use_quota=True,user_id='88b230f3578e474ea9e9b137341efbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53049bc2-870b-43bb-a60f-a21c4f34ef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53049bc2-870b-43bb-a60f-a21c4f34ef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0933fe4-34c8-4fa6-b305-07991da10e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0933fe4-34c8-4fa6-b305-07991da10e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92abeffd-2ddc-4d34-a1ad-abb43c60c126', 'volume_name': 'volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66e196fe-99f2-44ed-8f92-59b008f20845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66e196fe-99f2-44ed-8f92-59b008f20845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8dfa3a-6d82-4dac-8484-2938c837d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:29 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Volume 92abeffd-2ddc-4d34-a1ad-abb43c60c126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126', 'volume_size': 1} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:29 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b Jul 15 18:47:29 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:30 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b" returned: 0 in 0.357s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1819340604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d5e9742-1116-4986-847f-361f42f217bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60000e9f88bc48299f50451b5decf043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:28Z,use_quota=True,user_id='88b230f3578e474ea9e9b137341efbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Creating volume 4d5e9742-1116-4986-847f-361f42f217bf {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:30 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4d5e9742-1116-4986-847f-361f42f217bf 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334c38fb-2674-4b1f-891a-5745d5871716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a01a59-aa17-4420-8173-5708e57bb30b', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:30 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4d5e9742-1116-4986-847f-361f42f217bf 1073741824 Jul 15 18:47:30 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8e1972-3fd3-4fe1-9625-fe57352de0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:30 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume volume-77a01a59-aa17-4420-8173-5708e57bb30b (77a01a59-aa17-4420-8173-5708e57bb30b): created successfully Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8e1972-3fd3-4fe1-9625-fe57352de0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Flow 'volume_create_manager' (06d44f0f-a4e9-4f1e-a1de-15879341c5ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9645fb61-e73b-4c04-8ca7-663a6c51dfbc tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created volume successfully. Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Flow 'volume_create_manager' (20fb71e4-12dc-4a51-9a9c-b8a691db3085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a560cd82-c000-43ef-98a2-9425bd54fd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a560cd82-c000-43ef-98a2-9425bd54fd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092697211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9402a31-1cef-44c1-89fb-d8dc6d81cdf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60000e9f88bc48299f50451b5decf043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:30Z,use_quota=True,user_id='88b230f3578e474ea9e9b137341efbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1f9a3a-431f-4c27-b205-ed85e7fb1725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1f9a3a-431f-4c27-b205-ed85e7fb1725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc918ebd-65ca-423c-986e-7a0cb4d34985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc918ebd-65ca-423c-986e-7a0cb4d34985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9402a31-1cef-44c1-89fb-d8dc6d81cdf8', 'volume_name': 'volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f13bee-bb4d-43d4-9e0e-419a48b88d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f13bee-bb4d-43d4-9e0e-419a48b88d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df622777-4f96-4201-a30b-f6838e239064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:30 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Volume b9402a31-1cef-44c1-89fb-d8dc6d81cdf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8', 'volume_size': 1} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:30 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4d5e9742-1116-4986-847f-361f42f217bf 1073741824" returned: 0 in 0.497s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4d5e9742-1116-4986-847f-361f42f217bf {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:30 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4d5e9742-1116-4986-847f-361f42f217bf Jul 15 18:47:30 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:30 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4d5e9742-1116-4986-847f-361f42f217bf" returned: 0 in 0.261s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.017s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1528460784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab16c47-ea32-4b88-a951-4a27cf65fe60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60000e9f88bc48299f50451b5decf043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:29Z,use_quota=True,user_id='88b230f3578e474ea9e9b137341efbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Creating volume 9ab16c47-ea32-4b88-a951-4a27cf65fe60 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:30 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cfca78-2768-4292-93f5-271b1e14db32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d5e9742-1116-4986-847f-361f42f217bf', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:30 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60 1073741824 Jul 15 18:47:30 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a601df-1fa7-463e-8e22-ce451acc7f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:30 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Volume volume-4d5e9742-1116-4986-847f-361f42f217bf (4d5e9742-1116-4986-847f-361f42f217bf): created successfully Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a601df-1fa7-463e-8e22-ce451acc7f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Flow 'volume_create_manager' (965e42d3-7961-4a28-84b2-4f70f9309270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-655780a2-4cd4-4229-af7e-20e8c3bf2ffb tempest-CreateVolumesFromImageTest-362563130 None] Created volume successfully. Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:31 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60 1073741824" returned: 0 in 0.577s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:31 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60 Jul 15 18:47:31 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Flow 'volume_create_manager' (f3f8e84b-8490-4b18-bebd-9f5a9c3c09e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad21ce0-1c5e-45dc-8747-2156eb6cc619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:31 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60" returned: 0 in 0.304s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.635s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-304257256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8386940-c9f7-4104-8680-568c4448ebd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60000e9f88bc48299f50451b5decf043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:29Z,use_quota=True,user_id='88b230f3578e474ea9e9b137341efbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Creating volume c8386940-c9f7-4104-8680-568c4448ebd9 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:31 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c8386940-c9f7-4104-8680-568c4448ebd9 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad21ce0-1c5e-45dc-8747-2156eb6cc619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a110bdb0-8645-4c0b-86d5-be35f51cfb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27048aede4f740a7a6f71ef3ee49c236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:32Z,use_quota=True,user_id='cfd4d9ec2b324f75a20ffe77569612a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fee66e6-8155-4773-b26e-9ccebf60fb56),volume_type_id=1fee66e6-8155-4773-b26e-9ccebf60fb56)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc80fca-8124-43f7-bbf1-c915521beef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc80fca-8124-43f7-bbf1-c915521beef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:31 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c8386940-c9f7-4104-8680-568c4448ebd9 1073741824 Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c489384f-e7b0-4d26-bbee-6e5d0ddea540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:31 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.image.glance [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Creating Keystone auth plugin from conf {{(pid=87217) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e3d9f0-f05f-497a-8a30-31ecfb5e4a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18aa08aa-1932-4b3b-95b6-d6d06a74650c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:31 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Volume volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60 (9ab16c47-ea32-4b88-a951-4a27cf65fe60): created successfully Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18aa08aa-1932-4b3b-95b6-d6d06a74650c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Flow 'volume_create_manager' (88ba34f4-3167-4bf3-8786-86d17f1fbfca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:32 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-54a19ca5-d1ca-4da2-849c-994f3edf929e tempest-CreateVolumesFromImageTest-362563130 None] Created volume successfully. Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c489384f-e7b0-4d26-bbee-6e5d0ddea540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a110bdb0-8645-4c0b-86d5-be35f51cfb5a', 'volume_name': 'volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a', 'volume_size': 1, 'image_id': 'd32649bb-197f-427b-afec-41770faeace1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d32649bb-197f-427b-afec-41770faeace1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b60d2791e212b575aecfbfaf135181c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27048aede4f740a7a6f71ef3ee49c236', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21ff034e20e0eb7dca9c41ff39c282af35d674358ccad4428297afb49ca20f64018a9cb5b039c466bbde6c3bb40f97ae009c1159f39003a9201609fe1680e56d', 'id': 'd32649bb-197f-427b-afec-41770faeace1', 'created_at': datetime.datetime(2026, 7, 15, 16, 47, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 47, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d32649bb-197f-427b-afec-41770faeace1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82342f94-38c5-4462-addb-860353726091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82342f94-38c5-4462-addb-860353726091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346080e2-c867-45ae-9cfc-828c018fb5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:32 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Volume a110bdb0-8645-4c0b-86d5-be35f51cfb5a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a', 'volume_size': 1, 'image_id': 'd32649bb-197f-427b-afec-41770faeace1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d32649bb-197f-427b-afec-41770faeace1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b60d2791e212b575aecfbfaf135181c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27048aede4f740a7a6f71ef3ee49c236', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21ff034e20e0eb7dca9c41ff39c282af35d674358ccad4428297afb49ca20f64018a9cb5b039c466bbde6c3bb40f97ae009c1159f39003a9201609fe1680e56d', 'id': 'd32649bb-197f-427b-afec-41770faeace1', 'created_at': datetime.datetime(2026, 7, 15, 16, 47, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 47, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d32649bb-197f-427b-afec-41770faeace1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Trying to clone a110bdb0-8645-4c0b-86d5-be35f51cfb5a from image d32649bb-197f-427b-afec-41770faeace1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d32649bb-197f-427b-afec-41770faeace1', 'metadata': {}}]). {{(pid=87217) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:47:32 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Image download 0.00 MB at 0.00 MB/s Jul 15 18:47:32 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c8386940-c9f7-4104-8680-568c4448ebd9 1073741824" returned: 0 in 0.520s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c8386940-c9f7-4104-8680-568c4448ebd9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f2d0a2-687c-4a60-b850-956a074d2147]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:32 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c8386940-c9f7-4104-8680-568c4448ebd9 Jul 15 18:47:32 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:32 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD Jul 15 18:47:32 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:32 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c8386940-c9f7-4104-8680-568c4448ebd9" returned: 0 in 0.270s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.099s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1288824360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92abeffd-2ddc-4d34-a1ad-abb43c60c126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60000e9f88bc48299f50451b5decf043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:29Z,use_quota=True,user_id='88b230f3578e474ea9e9b137341efbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Creating volume 92abeffd-2ddc-4d34-a1ad-abb43c60c126 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:32 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:32 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:32 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:32 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126 1073741824 Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0594df84-620e-494c-aa57-202e9e5a3d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8386940-c9f7-4104-8680-568c4448ebd9', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:32 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50be79b2-8b96-4b3b-87fc-d8b6c70fba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:32 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Volume volume-c8386940-c9f7-4104-8680-568c4448ebd9 (c8386940-c9f7-4104-8680-568c4448ebd9): created successfully Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50be79b2-8b96-4b3b-87fc-d8b6c70fba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Flow 'volume_create_manager' (6cfc3b41-dee6-49a2-aa2f-85ebd3172504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:32 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:32 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-dcc7d572-fcbf-439b-affa-c91d90ac3470 tempest-CreateVolumesFromImageTest-362563130 None] Created volume successfully. Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:32 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD Jul 15 18:47:32 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:32 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.254s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:47:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:47:33 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Temporary image d32649bb-197f-427b-afec-41770faeace1 is fetched for user cfd4d9ec2b324f75a20ffe77569612a0. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:47:33 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126 1073741824" returned: 0 in 0.498s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3cae66-bbf6-4153-9f47-4a7678cd5c1f]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:33 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126 Jul 15 18:47:33 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:33 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD Jul 15 18:47:33 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:33 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126" returned: 0 in 0.248s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.375s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8dfa3a-6d82-4dac-8484-2938c837d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2c95df-6a26-41f2-a44c-f9589972c6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] Creating offline snapshot 46845ffb-0d0d-4499-8aa6-1061ad67c71f of volume 0f8a9cad-a114-4744-b162-64e773f1e1ae {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:47:33 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Volume volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126 (92abeffd-2ddc-4d34-a1ad-abb43c60c126): created successfully Jul 15 18:47:33 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2c95df-6a26-41f2-a44c-f9589972c6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Flow 'volume_create_manager' (594704b7-2ae0-4867-b53d-4a6ee98e7c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fd4fa1-2c83-4fe6-9381-ea973116dd24]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:33 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-533b4939-2063-432d-812f-b794a9633066 tempest-CreateVolumesFromImageTest-362563130 None] Created volume successfully. Jul 15 18:47:33 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae Jul 15 18:47:33 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:33 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD Jul 15 18:47:33 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:33 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:33 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae" returned: 0 in 0.378s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:34 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f 1G Jul 15 18:47:34 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:34 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f 1G" returned: 0 in 0.393s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8a9cad-a114-4744-b162-64e773f1e1ae -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:34 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8a9cad-a114-4744-b162-64e773f1e1ae -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f Jul 15 18:47:34 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:34 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8a9cad-a114-4744-b162-64e773f1e1ae -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f" returned: 0 in 0.309s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:34 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f is being set with open permissions: ugo+rw Jul 15 18:47:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:34 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f Jul 15 18:47:34 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:34 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f" returned: 0 in 0.253s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:35 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.info Jul 15 18:47:35 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:35 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.info" returned: 0 in 0.269s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:35 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.info is being set with open permissions: ugo+rw Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:35 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.info Jul 15 18:47:35 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:35 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.info" returned: 0 in 0.263s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.279s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092697211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9402a31-1cef-44c1-89fb-d8dc6d81cdf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60000e9f88bc48299f50451b5decf043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:30Z,use_quota=True,user_id='88b230f3578e474ea9e9b137341efbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Creating volume b9402a31-1cef-44c1-89fb-d8dc6d81cdf8 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:35 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:35 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8 1073741824 Jul 15 18:47:35 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:35 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ce22816a-950a-4c5b-a08b-d72021d2e382 tempest-VolumeDependencyTests-111787306 None] Create snapshot completed successfully Jul 15 18:47:35 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8 1073741824" returned: 0 in 0.410s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:36 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8 Jul 15 18:47:36 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:36 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8" returned: 0 in 0.251s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.245s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df622777-4f96-4201-a30b-f6838e239064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13edeef-fb01-4256-ba61-3e9565b2afa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Creating offline snapshot 5fbe8f59-a828-474d-b615-fbcd024548af of volume 77a01a59-aa17-4420-8173-5708e57bb30b {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:47:36 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Volume volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8 (b9402a31-1cef-44c1-89fb-d8dc6d81cdf8): created successfully Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13edeef-fb01-4256-ba61-3e9565b2afa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Flow 'volume_create_manager' (20fb71e4-12dc-4a51-9a9c-b8a691db3085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f67ba9-9af2-4f3d-9d17-e2cacf7ec57a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:36 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-282575a5-d102-43e2-98e7-0880037f3d81 tempest-CreateVolumesFromImageTest-362563130 None] Created volume successfully. Jul 15 18:47:36 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b Jul 15 18:47:36 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:36 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "cinder-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b" returned: 0 in 0.418s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:36 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af 1G Jul 15 18:47:36 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "cinder-quobyte-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-quobyte-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[68532ed8-9597-4c09-ae52-5aff66aecd1b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Flow 'volume_create_manager' (78396830-35ed-4d39-bf22-a6de5460b63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce76270-23a1-4616-83a4-487dcc2ef465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:36 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8 Jul 15 18:47:36 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce76270-23a1-4616-83a4-487dcc2ef465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-276770773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46568b50-cc96-4060-bba9-866b032b97eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464967d491c24c8689413172760473b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46845ffb-0d0d-4499-8aa6-1061ad67c71f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:37Z,use_quota=True,user_id='0e5bfe1fa1724954842907d339d46a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be0d4e1-1817-4099-bac8-0f4b8bef5c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:36 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be0d4e1-1817-4099-bac8-0f4b8bef5c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad39c494-3959-4128-b925-3d240bbc7d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad39c494-3959-4128-b925-3d240bbc7d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '46568b50-cc96-4060-bba9-866b032b97eb', 'volume_name': 'volume-46568b50-cc96-4060-bba9-866b032b97eb', 'volume_size': 1, 'snapshot_id': '46845ffb-0d0d-4499-8aa6-1061ad67c71f'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb2baf7-7151-46cc-8aac-b4581745d6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb2baf7-7151-46cc-8aac-b4581745d6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee0fdab-53a9-42d2-bdc2-e967c942400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:37 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Volume 46568b50-cc96-4060-bba9-866b032b97eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-46568b50-cc96-4060-bba9-866b032b97eb', 'volume_size': 1, 'snapshot_id': '46845ffb-0d0d-4499-8aa6-1061ad67c71f'} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:37 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af 1G" returned: 0 in 0.453s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a01a59-aa17-4420-8173-5708e57bb30b -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:37 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a01a59-aa17-4420-8173-5708e57bb30b -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af Jul 15 18:47:37 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:37 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8" returned: 0 in 0.410s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:37 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8 Jul 15 18:47:37 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:37 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a01a59-aa17-4420-8173-5708e57bb30b -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af" returned: 0 in 0.295s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:37 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af is being set with open permissions: ugo+rw Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:37 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af Jul 15 18:47:37 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:37 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8" returned: 0 in 0.262s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-quobyte-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8" released by "delete_volume" :: held 0.720s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Created reservations ['32a56738-6baf-4cc9-83f9-366f2edee09a', '3418577b-c64d-4f26-9740-4d20bce12e9a', 'dfa2c73b-7451-47f6-96af-72e533497551', '0b6aa3aa-1f4d-4ab6-aad1-0ea0fb478ad8'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:37 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:37 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:37 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af" returned: 0 in 0.257s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:37 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.info Jul 15 18:47:37 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "cinder-92abeffd-2ddc-4d34-a1ad-abb43c60c126-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-92abeffd-2ddc-4d34-a1ad-abb43c60c126-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:37 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.300s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Deleted volume successfully. Jul 15 18:47:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "cinder-quobyte-92abeffd-2ddc-4d34-a1ad-abb43c60c126" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e3a7cd74-94b2-4ea2-9b14-ef7ebe8c8179 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-b9402a31-1cef-44c1-89fb-d8dc6d81cdf8-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-quobyte-92abeffd-2ddc-4d34-a1ad-abb43c60c126" acquired by "delete_volume" :: waited 0.027s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b1b4b2-4ba1-41c5-b39d-5df5d33c4844]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:38 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.info" returned: 0 in 0.316s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:38 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.info is being set with open permissions: ugo+rw Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:38 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.info Jul 15 18:47:38 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:38 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126 Jul 15 18:47:38 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:38 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.info" returned: 0 in 0.236s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.095s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.368s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a110bdb0-8645-4c0b-86d5-be35f51cfb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27048aede4f740a7a6f71ef3ee49c236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:32Z,use_quota=True,user_id='cfd4d9ec2b324f75a20ffe77569612a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fee66e6-8155-4773-b26e-9ccebf60fb56),volume_type_id=1fee66e6-8155-4773-b26e-9ccebf60fb56)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Creating volume a110bdb0-8645-4c0b-86d5-be35f51cfb5a {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:38 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:38 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a 1073741824 Jul 15 18:47:38 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:38 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d3e9809c-e3b2-4348-bf71-2f4167b48540 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Create snapshot completed successfully Jul 15 18:47:38 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126" returned: 0 in 0.387s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:38 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126 Jul 15 18:47:38 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:38 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-92abeffd-2ddc-4d34-a1ad-abb43c60c126" returned: 0 in 0.254s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-quobyte-92abeffd-2ddc-4d34-a1ad-abb43c60c126" released by "delete_volume" :: held 0.680s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Created reservations ['612e6e51-c551-429f-b37f-3cc61ca833d0', 'b1b212fc-213f-44b0-9ecb-e2babd39522a', '216ee206-bd48-48ac-8580-239ee419b30b', 'f1f7b8d7-1b28-47b0-8468-2a84ef6ccdc1'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:38 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a 1073741824" returned: 0 in 0.484s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:38 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:38 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:38 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a Jul 15 18:47:38 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "cinder-c8386940-c9f7-4104-8680-568c4448ebd9-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:39 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.271s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:39 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Deleted volume successfully. Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-c8386940-c9f7-4104-8680-568c4448ebd9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-76fa08cb-c93a-4cbf-afbb-ee0d9d547b20 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-92abeffd-2ddc-4d34-a1ad-abb43c60c126-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "cinder-quobyte-c8386940-c9f7-4104-8680-568c4448ebd9" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:39 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a" returned: 0 in 0.289s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.136s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "cinder-quobyte-46845ffb-0d0d-4499-8aa6-1061ad67c71f-46568b50-cc96-4060-bba9-866b032b97eb" by "_create_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-quobyte-c8386940-c9f7-4104-8680-568c4448ebd9" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-quobyte-46845ffb-0d0d-4499-8aa6-1061ad67c71f-46568b50-cc96-4060-bba9-866b032b97eb" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Creating volume 46568b50-cc96-4060-bba9-866b032b97eb from snapshot 46845ffb-0d0d-4499-8aa6-1061ad67c71f {{(pid=87217) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "cinder-quobyte-46568b50-cc96-4060-bba9-866b032b97eb" by "_copy_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b426cd7-5621-4316-8632-bb8880baded7]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c8386940-c9f7-4104-8680-568c4448ebd9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Attempting download of d32649bb-197f-427b-afec-41770faeace1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d32649bb-197f-427b-afec-41770faeace1', 'metadata': {}}])) to volume a110bdb0-8645-4c0b-86d5-be35f51cfb5a. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-quobyte-46568b50-cc96-4060-bba9-866b032b97eb" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] snapshot: 46845ffb-0d0d-4499-8aa6-1061ad67c71f, volume: 46568b50-cc96-4060-bba9-866b032b97eb, {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2e6775-f0a0-43de-b00a-dd93fa35674f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a6cb5d-5f18-401d-8dcb-f5725be10c8f]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d32649bb-197f-427b-afec-41770faeace1_avdcm54_ {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:39 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c8386940-c9f7-4104-8680-568c4448ebd9 Jul 15 18:47:39 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:39 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f Jul 15 18:47:39 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:39 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d32649bb-197f-427b-afec-41770faeace1_avdcm54_ Jul 15 18:47:39 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:39 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c8386940-c9f7-4104-8680-568c4448ebd9" returned: 0 in 0.397s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c8386940-c9f7-4104-8680-568c4448ebd9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:39 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c8386940-c9f7-4104-8680-568c4448ebd9 Jul 15 18:47:39 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:39 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d32649bb-197f-427b-afec-41770faeace1_avdcm54_" returned: 0 in 0.442s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d32649bb-197f-427b-afec-41770faeace1_avdcm54_ {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:39 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f" returned: 0 in 0.498s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f8a9cad-a114-4744-b162-64e773f1e1ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Creating direct copy from snapshot {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e597a23-45a4-4a10-a1d2-320f6f8df343]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:39 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:40 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d32649bb-197f-427b-afec-41770faeace1_avdcm54_ Jul 15 18:47:40 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:40 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Flow 'volume_create_manager' (dcdd45e9-103c-4649-98ed-2c27d5d388e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee04cf49-b13c-4de0-9a2a-10802d510f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:40 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae Jul 15 18:47:40 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c8386940-c9f7-4104-8680-568c4448ebd9" returned: 0 in 0.438s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee04cf49-b13c-4de0-9a2a-10802d510f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-648608164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff31e793-1ba5-4dfe-8466-15b49f3ecea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3307d0c4dd14c2f8ec8edff795fef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:40Z,use_quota=True,user_id='01416f95a0bf4b97961e930b39ede57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20743e2-f747-4ace-8758-20bbd90854b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20743e2-f747-4ace-8758-20bbd90854b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8752c5eb-3543-4a09-b5d0-fee419d1b8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8752c5eb-3543-4a09-b5d0-fee419d1b8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff31e793-1ba5-4dfe-8466-15b49f3ecea9', 'volume_name': 'volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e42891-55a2-41bf-9661-1acd47c351a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e42891-55a2-41bf-9661-1acd47c351a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175671b4-71d4-4c4c-94df-9c566d777ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:40 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume ff31e793-1ba5-4dfe-8466-15b49f3ecea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9', 'volume_size': 1} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-quobyte-c8386940-c9f7-4104-8680-568c4448ebd9" released by "delete_volume" :: held 0.988s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:40 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d32649bb-197f-427b-afec-41770faeace1_avdcm54_" returned: 1 in 0.516s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d32649bb-197f-427b-afec-41770faeace1_avdcm54_' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[122e2e90-b70e-4a20-ab21-9266f33be91b]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Created reservations ['31c41570-9d80-403d-803a-7b524c735db9', '60f8ee9f-b37e-4354-bde2-8bcdb4095639', '07279188-11e1-459f-b722-e2ca84aefc72', 'f4b8fafa-48a3-4519-8abf-89e70afc4b7a'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:40 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:40 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:40 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:40 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae" returned: 0 in 0.660s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:40 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.utils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Path /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb not found in is_blk_device check {{(pid=87217) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:40 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb Jul 15 18:47:40 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Flow 'volume_create_manager' (dba5f181-e800-4129-a935-fc87d5b52f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308d0cf7-a46c-483f-a138-141b8417641b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308d0cf7-a46c-483f-a138-141b8417641b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406091754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a598d5-36e1-4493-966f-5d4596aabaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3307d0c4dd14c2f8ec8edff795fef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:40Z,use_quota=True,user_id='01416f95a0bf4b97961e930b39ede57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be3fa76-e302-4f13-bfbf-f1f912e2ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be3fa76-e302-4f13-bfbf-f1f912e2ada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f337f470-6c19-4c66-8b8a-694e833fecef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f337f470-6c19-4c66-8b8a-694e833fecef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a598d5-36e1-4493-966f-5d4596aabaa1', 'volume_name': 'volume-69a598d5-36e1-4493-966f-5d4596aabaa1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09183fbb-cb26-44f0-a74a-853f761f2309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09183fbb-cb26-44f0-a74a-853f761f2309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8878db8e-73d9-4af6-a6e7-158ff171acf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:40 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume 69a598d5-36e1-4493-966f-5d4596aabaa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a598d5-36e1-4493-966f-5d4596aabaa1', 'volume_size': 1} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:40 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.297s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:40 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Deleted volume successfully. Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0938624e-274c-45d2-b77c-357f7a77f469 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-c8386940-c9f7-4104-8680-568c4448ebd9-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:40 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:40 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD Jul 15 18:47:40 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Flow 'volume_create_manager' (6962701b-5fe7-4291-8a98-779bef901263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b300ad-3360-4176-bce2-7fbf98a7e37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b300ad-3360-4176-bce2-7fbf98a7e37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-73650187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd96658-a8d1-4a7a-a695-3943aca8ae41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3307d0c4dd14c2f8ec8edff795fef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:41Z,use_quota=True,user_id='01416f95a0bf4b97961e930b39ede57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd755a4-980d-422f-934c-db93263372fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd755a4-980d-422f-934c-db93263372fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6679811-ded4-4efe-8ff9-2495cf277d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6679811-ded4-4efe-8ff9-2495cf277d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd96658-a8d1-4a7a-a695-3943aca8ae41', 'volume_name': 'volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7efefd3-dac9-4acf-a4f8-a01e67d69228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7efefd3-dac9-4acf-a4f8-a01e67d69228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269aa737-7e3b-44e3-9a55-f6bc465f3476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:41 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume ddd96658-a8d1-4a7a-a695-3943aca8ae41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41', 'volume_size': 1} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:41 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD" returned: 1 in 0.573s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] d32649bb-197f-427b-afec-41770faeace1 was raw, converting to raw {{(pid=87217) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "cinder-9ab16c47-ea32-4b88-a951-4a27cf65fe60-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:41 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a Jul 15 18:47:41 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-9ab16c47-ea32-4b88-a951-4a27cf65fe60-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "cinder-quobyte-9ab16c47-ea32-4b88-a951-4a27cf65fe60" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-quobyte-9ab16c47-ea32-4b88-a951-4a27cf65fe60" acquired by "delete_volume" :: waited 0.056s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[838443ce-35e9-4a78-a533-df3e93839b38]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Flow 'volume_create_manager' (af44c665-3d96-4cb8-baca-03e2662fbb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:42 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60 Jul 15 18:47:42 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31acebaf-74c2-4fc2-8d92-f9bafb1b8b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:42 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31acebaf-74c2-4fc2-8d92-f9bafb1b8b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994863434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce2b4cb-eaa1-494b-b815-e24a038c1acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3307d0c4dd14c2f8ec8edff795fef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:42Z,use_quota=True,user_id='01416f95a0bf4b97961e930b39ede57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2527ee02-b209-49e8-895a-69c53c18bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2527ee02-b209-49e8-895a-69c53c18bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba82fe51-3a2d-45b7-b234-417efc38848c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba82fe51-3a2d-45b7-b234-417efc38848c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce2b4cb-eaa1-494b-b815-e24a038c1acc', 'volume_name': 'volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dadb00-64b7-4cc6-8960-9b7bb5a6ba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dadb00-64b7-4cc6-8960-9b7bb5a6ba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa1ae9f-9b70-4afe-b6d5-9587c72866c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:42 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume 5ce2b4cb-eaa1-494b-b815-e24a038c1acc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc', 'volume_size': 1} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a" returned: 0 in 1.087s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d32649bb-197f-427b-afec-41770faeace1_kda8aahpdevstack@QuobyteHD, size 0.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:47:42 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Converted 0.00 MB image at 0.00 MB/s Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:42 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a 1G Jul 15 18:47:42 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:42 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60" returned: 0 in 0.687s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:42 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60 Jul 15 18:47:42 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:43 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a 1G" returned: 0 in 0.677s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd42d3d-2c70-4faf-9114-b00ca9e7fd27]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:43 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9ab16c47-ea32-4b88-a951-4a27cf65fe60" returned: 0 in 0.877s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-quobyte-9ab16c47-ea32-4b88-a951-4a27cf65fe60" released by "delete_volume" :: held 1.745s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:43 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a Jul 15 18:47:43 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Flow 'volume_create_manager' (8630a0a5-5025-4a11-a091-e3c251018441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0196a7-07a3-4f58-baa8-99ce27846b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0196a7-07a3-4f58-baa8-99ce27846b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425229234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4e3e88-207d-4eb3-a129-4b595852dd93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3307d0c4dd14c2f8ec8edff795fef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:43Z,use_quota=True,user_id='01416f95a0bf4b97961e930b39ede57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f63fe7-4a08-4560-aecb-a6bb753310ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f63fe7-4a08-4560-aecb-a6bb753310ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6d0039-328a-4c46-a1a6-4a902dd415b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6d0039-328a-4c46-a1a6-4a902dd415b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4e3e88-207d-4eb3-a129-4b595852dd93', 'volume_name': 'volume-1f4e3e88-207d-4eb3-a129-4b595852dd93', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43546aef-73a8-4cdf-a090-1d53b9254043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43546aef-73a8-4cdf-a090-1d53b9254043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9545fae8-8a9f-41f4-8a09-0a2038a0b2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:43 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume 1f4e3e88-207d-4eb3-a129-4b595852dd93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4e3e88-207d-4eb3-a129-4b595852dd93', 'volume_size': 1} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:43 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Created reservations ['f8fb8d5b-55ca-44fe-bd2f-a2c6cc3497d9', '1074315a-793b-4cad-abf6-92ffe21ce94b', '4543f43f-ec1d-4edd-be4c-593a3c686f8a', '7df0da08-6bc9-49ce-8934-7dc16fea8dc7'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:44 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:44 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a" returned: 0 in 0.787s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:44 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:44 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:44 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a Jul 15 18:47:44 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:44 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.510s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:44 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:44 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Deleted volume successfully. Jul 15 18:47:44 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e55aa196-027c-45ae-a0ab-cc42f4f3991b tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-9ab16c47-ea32-4b88-a951-4a27cf65fe60-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:45 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a" returned: 1 in 0.954s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Downloaded image d32649bb-197f-427b-afec-41770faeace1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d32649bb-197f-427b-afec-41770faeace1', 'metadata': {}}])) to volume a110bdb0-8645-4c0b-86d5-be35f51cfb5a successfully. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Temporary image d32649bb-197f-427b-afec-41770faeace1 for user cfd4d9ec2b324f75a20ffe77569612a0 is deleted. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Marking volume a110bdb0-8645-4c0b-86d5-be35f51cfb5a as bootable. {{(pid=87217) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Copying metadata from image d32649bb-197f-427b-afec-41770faeace1 to a110bdb0-8645-4c0b-86d5-be35f51cfb5a. {{(pid=87217) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Creating volume glance metadata for volume a110bdb0-8645-4c0b-86d5-be35f51cfb5a backed by image d32649bb-197f-427b-afec-41770faeace1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd32649bb-197f-427b-afec-41770faeace1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3b60d2791e212b575aecfbfaf135181c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87217) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "cinder-4d5e9742-1116-4986-847f-361f42f217bf-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-4d5e9742-1116-4986-847f-361f42f217bf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346080e2-c867-45ae-9cfc-828c018fb5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a', 'volume_size': 1, 'image_id': 'd32649bb-197f-427b-afec-41770faeace1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d32649bb-197f-427b-afec-41770faeace1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b60d2791e212b575aecfbfaf135181c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27048aede4f740a7a6f71ef3ee49c236', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21ff034e20e0eb7dca9c41ff39c282af35d674358ccad4428297afb49ca20f64018a9cb5b039c466bbde6c3bb40f97ae009c1159f39003a9201609fe1680e56d', 'id': 'd32649bb-197f-427b-afec-41770faeace1', 'created_at': datetime.datetime(2026, 7, 15, 16, 47, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 47, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d32649bb-197f-427b-afec-41770faeace1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93435ab6-c2ad-44fb-a672-5935bc48aa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "cinder-quobyte-4d5e9742-1116-4986-847f-361f42f217bf" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:45 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Volume volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a (a110bdb0-8645-4c0b-86d5-be35f51cfb5a): created successfully Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93435ab6-c2ad-44fb-a672-5935bc48aa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Flow 'volume_create_manager' (f3f8e84b-8490-4b18-bebd-9f5a9c3c09e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-quobyte-4d5e9742-1116-4986-847f-361f42f217bf" acquired by "delete_volume" :: waited 0.107s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:45 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ef2a3ddb-8f04-4cf4-9eba-3d6aa61cc4a7 tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Created volume successfully. Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceebfbd-b7d0-4051-a687-97b199d5f75c]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4d5e9742-1116-4986-847f-361f42f217bf {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:45 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4d5e9742-1116-4986-847f-361f42f217bf Jul 15 18:47:45 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:46 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4d5e9742-1116-4986-847f-361f42f217bf" returned: 0 in 1.012s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4d5e9742-1116-4986-847f-361f42f217bf {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:46 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4d5e9742-1116-4986-847f-361f42f217bf Jul 15 18:47:46 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Acquiring lock "cinder-a110bdb0-8645-4c0b-86d5-be35f51cfb5a-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Lock "cinder-a110bdb0-8645-4c0b-86d5-be35f51cfb5a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Acquiring lock "cinder-quobyte-a110bdb0-8645-4c0b-86d5-be35f51cfb5a" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:46 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Lock "cinder-quobyte-a110bdb0-8645-4c0b-86d5-be35f51cfb5a" acquired by "delete_volume" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:46 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb" returned: 0 in 6.321s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:46 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76faa58-f9bc-4d4f-8106-290ccc86769f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:46 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f115fc29-eb29-4ee6-8654-c683496eca9e]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:47 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae Jul 15 18:47:47 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:47 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a Jul 15 18:47:47 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:47 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4d5e9742-1116-4986-847f-361f42f217bf" returned: 0 in 0.591s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-quobyte-4d5e9742-1116-4986-847f-361f42f217bf" released by "delete_volume" :: held 1.676s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Created reservations ['c75888e6-0575-4bfa-a958-5dd411afdddb', 'bdc289b9-65ed-413c-8052-77477e10f2ce', 'f6c79b4b-ccfc-4e99-be88-b2f9f40d6a36', 'fdda5d63-b411-44ea-85ed-c8167e1c8354'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:47 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:47 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:47 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a" returned: 0 in 0.407s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:47 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a Jul 15 18:47:47 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:47 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.268s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:47 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:47 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Deleted volume successfully. Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae" returned: 0 in 0.623s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:47:47 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Converted 1024.00 MB image at 161.89 MB/s Jul 15 18:47:47 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb is being set with open permissions: ugo+rw Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f484fcc6-53a1-4fe4-9c27-a5cce6602849 tempest-CreateVolumesFromImageTest-362563130 None] Lock "cinder-4d5e9742-1116-4986-847f-361f42f217bf-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:47 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb Jul 15 18:47:47 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:47 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a" returned: 1 in 0.367s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:47 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a Jul 15 18:47:47 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:47 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb" returned: 0 in 0.258s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-quobyte-46568b50-cc96-4060-bba9-866b032b97eb" released by "_copy_volume_from_snapshot" :: held 8.498s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-quobyte-46845ffb-0d0d-4499-8aa6-1061ad67c71f-46568b50-cc96-4060-bba9-866b032b97eb" released by "_create_volume_from_snapshot" :: held 8.549s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.583s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.594s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-648608164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff31e793-1ba5-4dfe-8466-15b49f3ecea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3307d0c4dd14c2f8ec8edff795fef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:40Z,use_quota=True,user_id='01416f95a0bf4b97961e930b39ede57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Creating volume ff31e793-1ba5-4dfe-8466-15b49f3ecea9 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:47 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:47 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9 1073741824 Jul 15 18:47:47 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee0fdab-53a9-42d2-bdc2-e967c942400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46568b50-cc96-4060-bba9-866b032b97eb', 'volume_size': 1, 'snapshot_id': '46845ffb-0d0d-4499-8aa6-1061ad67c71f'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a34b99-600e-42ea-bca8-e2a2cb84fc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:47 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Volume volume-46568b50-cc96-4060-bba9-866b032b97eb (46568b50-cc96-4060-bba9-866b032b97eb): created successfully Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a34b99-600e-42ea-bca8-e2a2cb84fc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Flow 'volume_create_manager' (78396830-35ed-4d39-bf22-a6de5460b63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:47 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ca7ac7bc-2732-4337-9e18-481106ffc6f6 tempest-VolumeDependencyTests-111787306 None] Created volume successfully. Jul 15 18:47:47 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a110bdb0-8645-4c0b-86d5-be35f51cfb5a" returned: 0 in 0.278s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Lock "cinder-quobyte-a110bdb0-8645-4c0b-86d5-be35f51cfb5a" released by "delete_volume" :: held 1.141s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Created reservations ['b6ece2b5-a4a7-49ae-bb1b-3dc335d28bc0', '47350b0d-4bb9-4c5c-a6d2-859adacc1438', 'db97d5d8-1991-4475-bc7a-d33fe6ccbb93', 'c018db14-59fb-4b87-b9e3-2ad13d0a1f77'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:48 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:48 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "cinder-46845ffb-0d0d-4499-8aa6-1061ad67c71f-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-46845ffb-0d0d-4499-8aa6-1061ad67c71f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "cinder-quobyte-0f8a9cad-a114-4744-b162-64e773f1e1ae" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-quobyte-0f8a9cad-a114-4744-b162-64e773f1e1ae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "cinder-quobyte-46845ffb-0d0d-4499-8aa6-1061ad67c71f" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-quobyte-46845ffb-0d0d-4499-8aa6-1061ad67c71f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Deleting offline snapshot 46845ffb-0d0d-4499-8aa6-1061ad67c71f of volume 0f8a9cad-a114-4744-b162-64e773f1e1ae {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] snapshot_file for this snap is: volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d92206-5977-4460-b7bc-d972b28d9ca1]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:48 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9 1073741824" returned: 0 in 0.583s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:48 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f Jul 15 18:47:48 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:48 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9 Jul 15 18:47:48 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:48 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.339s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:48 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Deleted volume successfully. Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e9b4b703-f86b-49d7-a5fe-990f3efa0a8f tempest-VolumeAndVolumeTypeFromImageTest-223921404 None] Lock "cinder-a110bdb0-8645-4c0b-86d5-be35f51cfb5a-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:48 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f" returned: 0 in 0.424s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f8a9cad-a114-4744-b162-64e773f1e1ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:47:48 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9" returned: 0 in 0.336s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f2682d-4882-4522-8a8e-4b2e853519cc]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.988s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406091754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a598d5-36e1-4493-966f-5d4596aabaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3307d0c4dd14c2f8ec8edff795fef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:40Z,use_quota=True,user_id='01416f95a0bf4b97961e930b39ede57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Creating volume 69a598d5-36e1-4493-966f-5d4596aabaa1 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:48 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-69a598d5-36e1-4493-966f-5d4596aabaa1 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:48 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-69a598d5-36e1-4493-966f-5d4596aabaa1 1073741824 Jul 15 18:47:48 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175671b4-71d4-4c4c-94df-9c566d777ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452614b3-5e3d-4e10-bd4d-9a72745d8904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:48 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9 (ff31e793-1ba5-4dfe-8466-15b49f3ecea9): created successfully Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452614b3-5e3d-4e10-bd4d-9a72745d8904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:48 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Flow 'volume_create_manager' (dcdd45e9-103c-4649-98ed-2c27d5d388e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:48 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d48b33ed-21e7-4f1f-a604-cb9c7a972f4d tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created volume successfully. Jul 15 18:47:48 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae Jul 15 18:47:48 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:49 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae" returned: 0 in 0.470s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:49 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f Jul 15 18:47:49 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:49 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-69a598d5-36e1-4493-966f-5d4596aabaa1 1073741824" returned: 0 in 0.617s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-69a598d5-36e1-4493-966f-5d4596aabaa1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:49 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-69a598d5-36e1-4493-966f-5d4596aabaa1 Jul 15 18:47:49 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:49 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f" returned: 0 in 0.420s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:49 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f Jul 15 18:47:49 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:49 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-69a598d5-36e1-4493-966f-5d4596aabaa1" returned: 0 in 0.284s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.428s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-73650187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd96658-a8d1-4a7a-a695-3943aca8ae41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3307d0c4dd14c2f8ec8edff795fef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:41Z,use_quota=True,user_id='01416f95a0bf4b97961e930b39ede57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Creating volume ddd96658-a8d1-4a7a-a695-3943aca8ae41 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:49 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8878db8e-73d9-4af6-a6e7-158ff171acf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a598d5-36e1-4493-966f-5d4596aabaa1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b784987f-f623-414e-bff2-1d21c5fd88ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:49 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41 1073741824 Jul 15 18:47:49 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:49 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume volume-69a598d5-36e1-4493-966f-5d4596aabaa1 (69a598d5-36e1-4493-966f-5d4596aabaa1): created successfully Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b784987f-f623-414e-bff2-1d21c5fd88ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Flow 'volume_create_manager' (dba5f181-e800-4129-a935-fc87d5b52f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:49 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e955934a-0432-40b0-af3b-51f0470f4902 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created volume successfully. Jul 15 18:47:50 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae.46845ffb-0d0d-4499-8aa6-1061ad67c71f" returned: 0 in 0.374s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-quobyte-46845ffb-0d0d-4499-8aa6-1061ad67c71f" released by "_delete_snapshot" :: held 1.831s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-quobyte-0f8a9cad-a114-4744-b162-64e773f1e1ae" released by "delete_snapshot" :: held 1.861s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Created reservations ['70514a14-b606-4b97-a8a7-e2a64b36f941', 'd1b83596-62a7-4307-9b53-4c3685b6dd4d', '50bc68a1-fd94-4a2f-80f7-713dc2c13fb0', '9eb02df4-94a6-4572-a5a3-8a9db330163c'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:50 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Delete snapshot completed successfully. Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a12419eb-6575-4878-b3aa-d92bc6699622 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-46845ffb-0d0d-4499-8aa6-1061ad67c71f-delete_snapshot" released by "delete_snapshot" :: held 2.036s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "cinder-0f8a9cad-a114-4744-b162-64e773f1e1ae-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:50 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41 1073741824" returned: 0 in 0.736s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-0f8a9cad-a114-4744-b162-64e773f1e1ae-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "cinder-quobyte-0f8a9cad-a114-4744-b162-64e773f1e1ae" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:50 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41 Jul 15 18:47:50 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-quobyte-0f8a9cad-a114-4744-b162-64e773f1e1ae" acquired by "delete_volume" :: waited 0.029s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5f28e5-b5dc-4418-bb8f-cf2c4a210c6c]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:50 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae Jul 15 18:47:50 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:50 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41" returned: 0 in 0.295s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.288s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994863434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce2b4cb-eaa1-494b-b815-e24a038c1acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3307d0c4dd14c2f8ec8edff795fef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:42Z,use_quota=True,user_id='01416f95a0bf4b97961e930b39ede57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Creating volume 5ce2b4cb-eaa1-494b-b815-e24a038c1acc {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:50 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269aa737-7e3b-44e3-9a55-f6bc465f3476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c341897c-b890-4221-9652-f6e4803b2e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:50 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc 1073741824 Jul 15 18:47:50 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:50 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41 (ddd96658-a8d1-4a7a-a695-3943aca8ae41): created successfully Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c341897c-b890-4221-9652-f6e4803b2e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Flow 'volume_create_manager' (6962701b-5fe7-4291-8a98-779bef901263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:50 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8672bed6-5925-4ee2-b981-63e0174a69eb tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created volume successfully. Jul 15 18:47:51 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae" returned: 0 in 0.523s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:51 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae Jul 15 18:47:51 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:51 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f8a9cad-a114-4744-b162-64e773f1e1ae" returned: 0 in 0.380s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-quobyte-0f8a9cad-a114-4744-b162-64e773f1e1ae" released by "delete_volume" :: held 0.988s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:51 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc 1073741824" returned: 0 in 0.774s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Created reservations ['25377279-941f-460f-9955-60b0cc18f5ea', 'c2d80173-23f2-496c-82dc-ea697b14ff2a', 'd2e114d3-8e74-489b-805f-c5c004b02c39', 'f0df0546-d0fa-40a2-92ea-32fea2340aad'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:51 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc Jul 15 18:47:51 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Flow 'volume_create_manager' (cf0e6290-0a05-415e-9679-cde5814c0afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a5b806-da46-4720-9b60-0f7531990601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a5b806-da46-4720-9b60-0f7531990601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cdd3558-59b0-47c1-b062-170aeabb77ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c332c3e46124d1ab07ab5f7e70b03ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:52Z,use_quota=True,user_id='572bccf4a8ab4eea945370b3c1e7b8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410a205d-0e87-4b7b-8bf9-ccd212103e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410a205d-0e87-4b7b-8bf9-ccd212103e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c00029-5a5b-4003-88d5-b89fcdd7d4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c00029-5a5b-4003-88d5-b89fcdd7d4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cdd3558-59b0-47c1-b062-170aeabb77ad', 'volume_name': 'volume-9cdd3558-59b0-47c1-b062-170aeabb77ad', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d58f77c-4a2f-4a6b-babf-320914fa8528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d58f77c-4a2f-4a6b-babf-320914fa8528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5874e3-59ee-4095-97bb-9c80ec8cdf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:51 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Volume 9cdd3558-59b0-47c1-b062-170aeabb77ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cdd3558-59b0-47c1-b062-170aeabb77ad', 'volume_size': 1} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:51 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:51 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:52 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc" returned: 0 in 0.335s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.190s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425229234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4e3e88-207d-4eb3-a129-4b595852dd93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3307d0c4dd14c2f8ec8edff795fef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:43Z,use_quota=True,user_id='01416f95a0bf4b97961e930b39ede57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Creating volume 1f4e3e88-207d-4eb3-a129-4b595852dd93 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:52 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1f4e3e88-207d-4eb3-a129-4b595852dd93 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:52 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1f4e3e88-207d-4eb3-a129-4b595852dd93 1073741824 Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa1ae9f-9b70-4afe-b6d5-9587c72866c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:52 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eaa7b0d-a540-4124-a2d3-e1329645e8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:52 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc (5ce2b4cb-eaa1-494b-b815-e24a038c1acc): created successfully Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eaa7b0d-a540-4124-a2d3-e1329645e8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Flow 'volume_create_manager' (af44c665-3d96-4cb8-baca-03e2662fbb5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:52 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7bfe93a8-18c1-411b-9422-5226172e0871 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created volume successfully. Jul 15 18:47:52 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.338s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:52 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Deleted volume successfully. Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bbac36eb-c2d0-45fc-ada5-c79572452cc9 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-0f8a9cad-a114-4744-b162-64e773f1e1ae-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:52 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1f4e3e88-207d-4eb3-a129-4b595852dd93 1073741824" returned: 0 in 0.532s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1f4e3e88-207d-4eb3-a129-4b595852dd93 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:52 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1f4e3e88-207d-4eb3-a129-4b595852dd93 Jul 15 18:47:52 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "cinder-46568b50-cc96-4060-bba9-866b032b97eb-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-46568b50-cc96-4060-bba9-866b032b97eb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "cinder-quobyte-46568b50-cc96-4060-bba9-866b032b97eb" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-quobyte-46568b50-cc96-4060-bba9-866b032b97eb" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a01486-255a-482f-bca3-fe30065d38c9]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:52 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1f4e3e88-207d-4eb3-a129-4b595852dd93" returned: 0 in 0.296s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.070s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cdd3558-59b0-47c1-b062-170aeabb77ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c332c3e46124d1ab07ab5f7e70b03ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:52Z,use_quota=True,user_id='572bccf4a8ab4eea945370b3c1e7b8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Creating volume 9cdd3558-59b0-47c1-b062-170aeabb77ad {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:52 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9cdd3558-59b0-47c1-b062-170aeabb77ad 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9545fae8-8a9f-41f4-8a09-0a2038a0b2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4e3e88-207d-4eb3-a129-4b595852dd93', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db25243b-a604-42d9-9715-17b17cc60e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:52 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9cdd3558-59b0-47c1-b062-170aeabb77ad 1073741824 Jul 15 18:47:52 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:52 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb Jul 15 18:47:52 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:52 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Volume volume-1f4e3e88-207d-4eb3-a129-4b595852dd93 (1f4e3e88-207d-4eb3-a129-4b595852dd93): created successfully Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db25243b-a604-42d9-9715-17b17cc60e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Flow 'volume_create_manager' (8630a0a5-5025-4a11-a091-e3c251018441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:53 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-57db119b-668b-436a-b4c8-3032a73e38f3 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created volume successfully. Jul 15 18:47:53 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb" returned: 0 in 0.387s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:53 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb Jul 15 18:47:53 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-1f4e3e88-207d-4eb3-a129-4b595852dd93-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-1f4e3e88-207d-4eb3-a129-4b595852dd93-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:53 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9cdd3558-59b0-47c1-b062-170aeabb77ad 1073741824" returned: 0 in 0.575s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-quobyte-1f4e3e88-207d-4eb3-a129-4b595852dd93" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9cdd3558-59b0-47c1-b062-170aeabb77ad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:53 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-46568b50-cc96-4060-bba9-866b032b97eb" returned: 0 in 0.336s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-1f4e3e88-207d-4eb3-a129-4b595852dd93" acquired by "delete_volume" :: waited 0.035s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:53 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9cdd3558-59b0-47c1-b062-170aeabb77ad Jul 15 18:47:53 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-quobyte-46568b50-cc96-4060-bba9-866b032b97eb" released by "delete_volume" :: held 0.790s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d9931-da34-4207-84e9-728fb1c0f94d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1f4e3e88-207d-4eb3-a129-4b595852dd93 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Created reservations ['62bba06c-f1c4-476d-816a-fbabb78f3401', '165e15a8-1786-4c08-9c99-c7da4c86f69a', 'f5139140-5131-4f47-b5d3-2364c90a2f8b', 'c773d789-09f7-47eb-a4ba-adfb61ec7331'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:53 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1f4e3e88-207d-4eb3-a129-4b595852dd93 Jul 15 18:47:53 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:53 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9cdd3558-59b0-47c1-b062-170aeabb77ad" returned: 0 in 0.344s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:53 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:53 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5874e3-59ee-4095-97bb-9c80ec8cdf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cdd3558-59b0-47c1-b062-170aeabb77ad', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82fcf56e-4af5-4024-a81c-724d7a94bb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:53 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Volume volume-9cdd3558-59b0-47c1-b062-170aeabb77ad (9cdd3558-59b0-47c1-b062-170aeabb77ad): created successfully Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82fcf56e-4af5-4024-a81c-724d7a94bb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:53 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Flow 'volume_create_manager' (cf0e6290-0a05-415e-9679-cde5814c0afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-91da67c3-981d-4ebc-ab71-5832e7a22c13 tempest-CinderUnicodeTest-937944381 None] Created volume successfully. Jul 15 18:47:54 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1f4e3e88-207d-4eb3-a129-4b595852dd93" returned: 0 in 0.492s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1f4e3e88-207d-4eb3-a129-4b595852dd93 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:54 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1f4e3e88-207d-4eb3-a129-4b595852dd93 Jul 15 18:47:54 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:54 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.316s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Deleted volume successfully. Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-eb8de3f6-a253-40bc-be68-735b4ac35d91 tempest-VolumeDependencyTests-111787306 None] Lock "cinder-46568b50-cc96-4060-bba9-866b032b97eb-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:54 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1f4e3e88-207d-4eb3-a129-4b595852dd93" returned: 0 in 0.283s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-1f4e3e88-207d-4eb3-a129-4b595852dd93" released by "delete_volume" :: held 0.835s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created reservations ['67ae0a65-033c-4790-be11-4aa6c21fc7b9', 'e051d649-083c-4586-a73f-e4cd7e80fc20', 'ac120f11-726d-4aab-9d4a-21aea448096e', 'a697d92d-0f14-437f-91e5-e24987a37a9d'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:54 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:54 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-5ce2b4cb-eaa1-494b-b815-e24a038c1acc-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-5ce2b4cb-eaa1-494b-b815-e24a038c1acc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-quobyte-5ce2b4cb-eaa1-494b-b815-e24a038c1acc" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-5ce2b4cb-eaa1-494b-b815-e24a038c1acc" acquired by "delete_volume" :: waited 0.040s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60121e7-b940-48c2-b115-d43bb657885d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:55 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.443s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:55 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Deleted volume successfully. Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ce486501-46f0-4354-afd7-c0abf55bb44f tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-1f4e3e88-207d-4eb3-a129-4b595852dd93-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:55 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc Jul 15 18:47:55 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:55 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc" returned: 0 in 0.596s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:55 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc Jul 15 18:47:55 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Flow 'volume_create_manager' (2067c4c2-df3e-46f1-911b-ee1b6f108008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b51653fc-0c4d-4ea1-98c7-ed6c73ca7fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b51653fc-0c4d-4ea1-98c7-ed6c73ca7fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-975226646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d699e7d7-7d50-4ab6-bdd3-387abd00c0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c332c3e46124d1ab07ab5f7e70b03ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:56Z,use_quota=True,user_id='572bccf4a8ab4eea945370b3c1e7b8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea77a2b-e4fa-4a7d-b339-ed032c8c90d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea77a2b-e4fa-4a7d-b339-ed032c8c90d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8328d5d3-18ec-42e6-a735-3b08c72d9e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8328d5d3-18ec-42e6-a735-3b08c72d9e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd699e7d7-7d50-4ab6-bdd3-387abd00c0c7', 'volume_name': 'volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356407af-3524-404b-87e1-3dedd77c9d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356407af-3524-404b-87e1-3dedd77c9d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1791f2f-794d-4581-bdde-3e087b4fbab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:55 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Volume d699e7d7-7d50-4ab6-bdd3-387abd00c0c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7', 'volume_size': 1} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-975226646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d699e7d7-7d50-4ab6-bdd3-387abd00c0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c332c3e46124d1ab07ab5f7e70b03ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:56Z,use_quota=True,user_id='572bccf4a8ab4eea945370b3c1e7b8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Creating volume d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:55 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:55 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 1073741824 Jul 15 18:47:55 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:47:55 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (6ec86965-0f67-4c23-959c-59ae08704bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df85245-8287-47eb-8cd2-5e02234a45c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce2b4cb-eaa1-494b-b815-e24a038c1acc" returned: 0 in 0.492s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df85245-8287-47eb-8cd2-5e02234a45c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203417904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd10afc3-35c2-43ad-b5f9-d6e041e71c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:56Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a2404f-6c01-4d94-aaa9-3f8812743672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a2404f-6c01-4d94-aaa9-3f8812743672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a726a41f-e513-44fa-841c-30e53221a551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a726a41f-e513-44fa-841c-30e53221a551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd10afc3-35c2-43ad-b5f9-d6e041e71c2a', 'volume_name': 'volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e11d9f-52c8-49eb-97ed-41e8eacf418e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e11d9f-52c8-49eb-97ed-41e8eacf418e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98defa79-bc36-4fd0-8854-6db8dbbb2c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:56 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Volume fd10afc3-35c2-43ad-b5f9-d6e041e71c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a', 'volume_size': 1} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-5ce2b4cb-eaa1-494b-b815-e24a038c1acc" released by "delete_volume" :: held 1.231s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created reservations ['e5f65b19-ec2f-48f3-bc13-c6695a940d61', '9e56287e-54e0-4d4e-aaee-98b74ee1133e', 'ff5d580f-8231-4337-a167-31f8c44f8d08', '8823c650-77f7-4da7-b41c-1f47a000fae5'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:56 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:56 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:56 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 1073741824" returned: 0 in 0.545s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:56 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 Jul 15 18:47:56 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:56 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.263s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:56 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Deleted volume successfully. Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aad31c5a-f39b-4784-82b0-caa618b968ef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-5ce2b4cb-eaa1-494b-b815-e24a038c1acc-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:56 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7" returned: 0 in 0.296s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203417904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd10afc3-35c2-43ad-b5f9-d6e041e71c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:47:56Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Creating volume fd10afc3-35c2-43ad-b5f9-d6e041e71c2a {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:47:56 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:56 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a 1073741824 Jul 15 18:47:56 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1791f2f-794d-4581-bdde-3e087b4fbab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcaa21e8-eb02-451c-b948-2c194f620a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:56 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Volume volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 (d699e7d7-7d50-4ab6-bdd3-387abd00c0c7): created successfully Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcaa21e8-eb02-451c-b948-2c194f620a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:56 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Flow 'volume_create_manager' (2067c4c2-df3e-46f1-911b-ee1b6f108008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:56 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c83f752a-106c-412e-90ce-25c4ba8e8bf1 tempest-CinderUnicodeTest-937944381 None] Created volume successfully. Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-ddd96658-a8d1-4a7a-a695-3943aca8ae41-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-ddd96658-a8d1-4a7a-a695-3943aca8ae41-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-quobyte-ddd96658-a8d1-4a7a-a695-3943aca8ae41" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-ddd96658-a8d1-4a7a-a695-3943aca8ae41" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6053d0-d43b-4ce5-a5e1-56d2bc10f6ee]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:57 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a 1073741824" returned: 0 in 0.537s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:57 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41 Jul 15 18:47:57 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:57 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a Jul 15 18:47:57 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:57 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a" returned: 0 in 0.313s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98defa79-bc36-4fd0-8854-6db8dbbb2c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8dbe331-d98c-4733-9a27-a41fff6c9c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:47:57 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41" returned: 0 in 0.462s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:57 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Volume volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a (fd10afc3-35c2-43ad-b5f9-d6e041e71c2a): created successfully Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8dbe331-d98c-4733-9a27-a41fff6c9c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (6ec86965-0f67-4c23-959c-59ae08704bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:47:57 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41 Jul 15 18:47:57 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:57 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0e03e56d-f788-4bb8-812c-9c693603423b tempest-ProjectMemberTests-529349186 None] Created volume successfully. Jul 15 18:47:57 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ddd96658-a8d1-4a7a-a695-3943aca8ae41" returned: 0 in 0.309s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-ddd96658-a8d1-4a7a-a695-3943aca8ae41" released by "delete_volume" :: held 0.834s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] Creating offline snapshot d9c7c554-9da0-4a53-bbd8-bc159e231602 of volume d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created reservations ['03d563e7-2478-4272-a023-739504b6ce28', 'db1fe89b-57ad-46b8-9e5f-a2a734f82e84', 'd19186bc-3bf3-4f87-a657-270d33ce64b5', 'e211b504-3253-40dd-9a58-7cb076b92473'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0dead9-303f-4036-902a-7bf28214ed5c]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:58 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:58 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:58 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 Jul 15 18:47:58 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.331s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:58 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:58 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Deleted volume successfully. Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7" returned: 0 in 0.452s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:58 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 1G Jul 15 18:47:58 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5acb6a7-b693-488c-beba-ad610d906450 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-ddd96658-a8d1-4a7a-a695-3943aca8ae41-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-69a598d5-36e1-4493-966f-5d4596aabaa1-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-69a598d5-36e1-4493-966f-5d4596aabaa1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-quobyte-69a598d5-36e1-4493-966f-5d4596aabaa1" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-69a598d5-36e1-4493-966f-5d4596aabaa1" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafa0bfb-2677-4bc6-8a6d-07002b75974b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-69a598d5-36e1-4493-966f-5d4596aabaa1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:58 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-69a598d5-36e1-4493-966f-5d4596aabaa1 Jul 15 18:47:58 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:59 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 1G" returned: 0 in 0.532s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:59 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 Jul 15 18:47:59 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:59 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-69a598d5-36e1-4493-966f-5d4596aabaa1" returned: 0 in 0.396s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-69a598d5-36e1-4493-966f-5d4596aabaa1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:59 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-69a598d5-36e1-4493-966f-5d4596aabaa1 Jul 15 18:47:59 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:59 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602" returned: 0 in 0.299s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:59 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 is being set with open permissions: ugo+rw Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:59 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 Jul 15 18:47:59 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:59 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-69a598d5-36e1-4493-966f-5d4596aabaa1" returned: 0 in 0.258s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-69a598d5-36e1-4493-966f-5d4596aabaa1" released by "delete_volume" :: held 0.719s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created reservations ['5c3a48db-41bf-44d6-90ef-e11d54fbc148', '2d15947a-9194-436f-9bde-028568f58907', '5d4d5d43-c1a0-4cbf-9fe1-61a0852c2450', 'e7641827-d94d-4b85-9d35-c636b327f934'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:59 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602" returned: 0 in 0.254s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:59 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:47:59 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:59 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.info Jul 15 18:47:59 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:59 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.266s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:47:59 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Deleted volume successfully. Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-ff31e793-1ba5-4dfe-8466-15b49f3ecea9-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-ff31e793-1ba5-4dfe-8466-15b49f3ecea9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-da97d9f7-44d1-448f-8264-8962aa366ca6 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-69a598d5-36e1-4493-966f-5d4596aabaa1-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:47:59 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.info" returned: 0 in 0.289s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:47:59 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.info is being set with open permissions: ugo+rw Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-quobyte-ff31e793-1ba5-4dfe-8466-15b49f3ecea9" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:47:59 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.info Jul 15 18:47:59 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-ff31e793-1ba5-4dfe-8466-15b49f3ecea9" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[58764fee-88a0-427a-8eba-14c6c6d4d3cc]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:47:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:00 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9 Jul 15 18:48:00 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:00 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.info" returned: 0 in 0.264s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.627s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] Creating offline snapshot 706eade6-49b2-4eb5-b03d-dcbfff5e991b of volume fd10afc3-35c2-43ad-b5f9-d6e041e71c2a {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:00 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ce63b014-305a-4d30-a913-2329bfe30fa0 tempest-CinderUnicodeTest-937944381 None] Create snapshot completed successfully Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cad23f3-aefa-4070-8dd9-c2ca902ef103]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:00 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a Jul 15 18:48:00 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:00 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9" returned: 0 in 0.409s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:00 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9 Jul 15 18:48:00 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:00 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a" returned: 0 in 0.428s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:00 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-ff31e793-1ba5-4dfe-8466-15b49f3ecea9" returned: 0 in 0.302s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:00 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b 1G Jul 15 18:48:00 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-ff31e793-1ba5-4dfe-8466-15b49f3ecea9" released by "delete_volume" :: held 0.763s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created reservations ['ea8678f6-f18f-4329-987a-794decd96e23', '258ba19f-813f-4756-8333-f811b45d9979', '1e4907dd-9d71-4026-b568-6c7f0cb63e2e', 'fa1e3955-5772-4f07-8e0c-e5030e0ba224'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:00 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:00 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-5fbe8f59-a828-474d-b615-fbcd024548af-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-5fbe8f59-a828-474d-b615-fbcd024548af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-quobyte-77a01a59-aa17-4420-8173-5708e57bb30b" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-77a01a59-aa17-4420-8173-5708e57bb30b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-quobyte-5fbe8f59-a828-474d-b615-fbcd024548af" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-5fbe8f59-a828-474d-b615-fbcd024548af" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Deleting offline snapshot 5fbe8f59-a828-474d-b615-fbcd024548af of volume 77a01a59-aa17-4420-8173-5708e57bb30b {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] snapshot_file for this snap is: volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb795a2-2dc3-4ebd-b79f-3b3fdd058aae]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:01 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b 1G" returned: 0 in 0.541s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:01 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b Jul 15 18:48:01 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:01 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.415s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Acquiring lock "cinder-d9c7c554-9da0-4a53-bbd8-bc159e231602-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:01 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Deleted volume successfully. Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Lock "cinder-d9c7c554-9da0-4a53-bbd8-bc159e231602-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Acquiring lock "cinder-quobyte-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b7bdc176-1cfe-4581-b19a-0f16cc878ebe tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-ff31e793-1ba5-4dfe-8466-15b49f3ecea9-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:01 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af Jul 15 18:48:01 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Lock "cinder-quobyte-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Acquiring lock "cinder-quobyte-d9c7c554-9da0-4a53-bbd8-bc159e231602" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Lock "cinder-quobyte-d9c7c554-9da0-4a53-bbd8-bc159e231602" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Deleting offline snapshot d9c7c554-9da0-4a53-bbd8-bc159e231602 of volume d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] snapshot_file for this snap is: volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c9c8a6-2ba3-42de-8776-aaa2487b8ccd]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:01 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 Jul 15 18:48:01 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:01 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b" returned: 0 in 0.363s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:01 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b is being set with open permissions: ugo+rw Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:01 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af" returned: 0 in 0.438s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77a01a59-aa17-4420-8173-5708e57bb30b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:01 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b Jul 15 18:48:01 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4073f741-17b9-4a4b-9e08-3f52ca4aa1e4]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:01 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b Jul 15 18:48:01 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:01 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602" returned: 0 in 0.383s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a4b4dc-a442-43b9-8896-772378347a6e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:01 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b" returned: 0 in 0.263s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:01 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.info Jul 15 18:48:01 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:01 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 Jul 15 18:48:01 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:02 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b" returned: 0 in 0.398s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:02 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af Jul 15 18:48:02 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:02 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.info" returned: 0 in 0.257s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:02 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.info is being set with open permissions: ugo+rw Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:02 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.info Jul 15 18:48:02 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:02 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7" returned: 0 in 0.425s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:02 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 Jul 15 18:48:02 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:02 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.info" returned: 0 in 0.300s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:02 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af" returned: 0 in 0.449s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:02 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af Jul 15 18:48:02 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:02 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ecd4cb7f-544a-43d5-9218-b7bd84a92487 tempest-ProjectMemberTests-529349186 None] Create snapshot completed successfully Jul 15 18:48:02 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602" returned: 0 in 0.458s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:02 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602 Jul 15 18:48:02 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:02 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b.5fbe8f59-a828-474d-b615-fbcd024548af" returned: 0 in 0.298s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-5fbe8f59-a828-474d-b615-fbcd024548af" released by "_delete_snapshot" :: held 1.757s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-77a01a59-aa17-4420-8173-5708e57bb30b" released by "delete_snapshot" :: held 1.795s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-706eade6-49b2-4eb5-b03d-dcbfff5e991b-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Lock "cinder-706eade6-49b2-4eb5-b03d-dcbfff5e991b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:02 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-706eade6-49b2-4eb5-b03d-dcbfff5e991b" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-706eade6-49b2-4eb5-b03d-dcbfff5e991b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:03 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Deleting offline snapshot 706eade6-49b2-4eb5-b03d-dcbfff5e991b of volume fd10afc3-35c2-43ad-b5f9-d6e041e71c2a {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] snapshot_file for this snap is: volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7.d9c7c554-9da0-4a53-bbd8-bc159e231602" returned: 0 in 0.362s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created reservations ['6a4718b1-7b4c-4fbc-928a-0ea2a38d884a', 'f1b60633-435b-4e22-ad56-fc6453160603', 'fa7fa898-580a-4db2-be57-b825c3536be4', '3b5e5671-cab1-4cc6-a64e-f3aa3a6dc4f1'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d73f29-995b-4792-8230-48357dbf6c7d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Lock "cinder-quobyte-d9c7c554-9da0-4a53-bbd8-bc159e231602" released by "_delete_snapshot" :: held 1.797s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Lock "cinder-quobyte-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7" released by "delete_snapshot" :: held 1.839s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:03 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b Jul 15 18:48:03 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Delete snapshot completed successfully. Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-ba434e53-2fbc-4d0e-aa61-6e6efad6cdef tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-5fbe8f59-a828-474d-b615-fbcd024548af-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Created reservations ['41038d8e-7129-4e9a-af9a-ba6c17eaad57', '16c1c8ab-679c-466d-82ad-0b67d5e4cc6b', 'def35ae6-e376-48d3-af99-9aacb7571bce', '6eeae241-5870-4906-befe-7e4b2cddd441'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Delete snapshot completed successfully. Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a74b0756-ea26-44da-b83a-95e6006071bb tempest-CinderUnicodeTest-937944381 None] Lock "cinder-d9c7c554-9da0-4a53-bbd8-bc159e231602-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Acquiring lock "cinder-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Lock "cinder-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Acquiring lock "cinder-quobyte-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:03 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b" returned: 0 in 0.449s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Lock "cinder-quobyte-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7" acquired by "delete_volume" :: waited 0.036s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[1820f14d-e250-4596-9e00-25b8da113294]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fd7ca6-5722-4efc-ab82-54213be935cd]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:03 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a Jul 15 18:48:03 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:03 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 Jul 15 18:48:03 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:03 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a" returned: 0 in 0.363s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:03 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7" returned: 0 in 0.361s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:03 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b Jul 15 18:48:03 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:03 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7 Jul 15 18:48:03 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:04 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7" returned: 0 in 0.253s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Lock "cinder-quobyte-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7" released by "delete_volume" :: held 0.677s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-77a01a59-aa17-4420-8173-5708e57bb30b-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Created reservations ['39908ea2-66cf-46c3-b7ec-6da0b2117833', '13c9c66a-adfe-42f3-9d2c-ea8ef9753f1f', '6d8c67d7-536c-4474-9012-ebf2f25e04b0', '45592e92-cf52-461e-acd8-1e6a931bb273'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-77a01a59-aa17-4420-8173-5708e57bb30b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:04 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b" returned: 0 in 0.423s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:04 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b Jul 15 18:48:04 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "cinder-quobyte-77a01a59-aa17-4420-8173-5708e57bb30b" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-77a01a59-aa17-4420-8173-5708e57bb30b" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ed12d7-afdf-4b4f-aba4-d30db1d01a77]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:04 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:04 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Acquiring lock "cinder-9cdd3558-59b0-47c1-b062-170aeabb77ad-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:04 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a.706eade6-49b2-4eb5-b03d-dcbfff5e991b" returned: 0 in 0.359s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:04 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b Jul 15 18:48:04 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Lock "cinder-9cdd3558-59b0-47c1-b062-170aeabb77ad-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-706eade6-49b2-4eb5-b03d-dcbfff5e991b" released by "_delete_snapshot" :: held 1.772s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a" released by "delete_snapshot" :: held 1.820s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Acquiring lock "cinder-quobyte-9cdd3558-59b0-47c1-b062-170aeabb77ad" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Lock "cinder-quobyte-9cdd3558-59b0-47c1-b062-170aeabb77ad" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[04593e06-5d6d-4ee5-97cf-33d950499ae4]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9cdd3558-59b0-47c1-b062-170aeabb77ad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:04 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.433s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:04 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Deleted volume successfully. Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Created reservations ['96199b51-71da-4a3b-b372-17d539999509', '85da0d19-7c4f-4dd3-b074-b117f8f1bc68', '47db61b4-0786-4b51-8ca1-a752ae91b238', '4a024247-bf15-4d81-b63e-2ea7f59aae8e'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3053473e-698c-4277-9989-6687ea1b0cfc tempest-CinderUnicodeTest-937944381 None] Lock "cinder-d699e7d7-7d50-4ab6-bdd3-387abd00c0c7-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:05 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9cdd3558-59b0-47c1-b062-170aeabb77ad Jul 15 18:48:05 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:05 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Delete snapshot completed successfully. Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f4968dd6-c7f4-4822-8364-67f701855b76 tempest-ProjectMemberTests-529349186 None] Lock "cinder-706eade6-49b2-4eb5-b03d-dcbfff5e991b-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:05 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b" returned: 0 in 0.575s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:05 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b Jul 15 18:48:05 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Lock "cinder-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c45f980-8f90-4c64-bc2f-767e555b14e1]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:05 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9cdd3558-59b0-47c1-b062-170aeabb77ad" returned: 0 in 0.513s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9cdd3558-59b0-47c1-b062-170aeabb77ad {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:05 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9cdd3558-59b0-47c1-b062-170aeabb77ad Jul 15 18:48:05 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:05 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-77a01a59-aa17-4420-8173-5708e57bb30b" returned: 0 in 0.365s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:05 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a Jul 15 18:48:05 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-quobyte-77a01a59-aa17-4420-8173-5708e57bb30b" released by "delete_volume" :: held 1.045s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Created reservations ['cf9d9d47-9cca-4a90-a7bc-6314fbc0c393', '1b6790fb-4808-42ab-af17-5a09651a4a16', 'ffec5314-8449-4d09-ae89-f3f32d85ff5a', 'd62b7175-65b7-4ef3-b4f2-52379a9adcf8'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:05 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:05 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:05 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-9cdd3558-59b0-47c1-b062-170aeabb77ad" returned: 0 in 0.291s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Lock "cinder-quobyte-9cdd3558-59b0-47c1-b062-170aeabb77ad" released by "delete_volume" :: held 0.863s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:05 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a" returned: 0 in 0.460s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:05 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a Jul 15 18:48:05 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Created reservations ['2d36e4e0-4bd5-421c-ae7f-e2277089f08f', 'fe38ab8e-07fa-48db-8b2d-cdf17d6c7733', '3733d696-65f7-416f-8d88-e8051edaf2c4', '24bdc116-a633-4f3a-8773-557381eb91f6'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:05 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:05 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.326s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:05 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:05 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:05 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Deleted volume successfully. Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2eb2ddb3-3e61-4e9b-9381-34efdd3d5615 tempest-CreateVolumesFromSnapshotTest-1143333976 None] Lock "cinder-77a01a59-aa17-4420-8173-5708e57bb30b-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:06 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a" returned: 0 in 0.360s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a" released by "delete_volume" :: held 0.885s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Created reservations ['54f1ae43-be3c-4f2a-8618-af0e1d92683a', 'c3f8a32d-aa07-41a1-b4bd-79ff2a243e97', '08106567-554c-46ed-86c7-527994aeadf0', 'dc1d1b18-da1b-4cfb-9ad5-d1731a3a5e7b'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:06 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.294s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:06 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Deleted volume successfully. Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9acc32eb-08d2-4275-b22b-d9358936b744 tempest-CinderUnicodeTest-937944381 None] Lock "cinder-9cdd3558-59b0-47c1-b062-170aeabb77ad-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:06 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:06 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:06 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.301s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:06 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Deleted volume successfully. Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8a424b97-ca1e-46f9-8c6b-8ad6a8f1ad8d tempest-ProjectMemberTests-529349186 None] Lock "cinder-fd10afc3-35c2-43ad-b5f9-d6e041e71c2a-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (7e7aacd4-6c1e-437b-ad13-52ea0b5242fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1808114c-9ac3-4c4c-b883-f7bf4b352863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:06 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1808114c-9ac3-4c4c-b883-f7bf4b352863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712846705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb0e790-54a8-4d22-9263-9014ab8a37b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:07Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00b7b6c-330e-4a9c-96cc-a8bdf38f7473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00b7b6c-330e-4a9c-96cc-a8bdf38f7473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e108b640-cfb9-4860-ab05-7590c403a5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e108b640-cfb9-4860-ab05-7590c403a5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb0e790-54a8-4d22-9263-9014ab8a37b0', 'volume_name': 'volume-deb0e790-54a8-4d22-9263-9014ab8a37b0', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bded0b1-e2da-4ce4-befb-9e7fa2584171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bded0b1-e2da-4ce4-befb-9e7fa2584171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ab754e-b050-46bd-b69b-4664dc0da470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:07 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Volume deb0e790-54a8-4d22-9263-9014ab8a37b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb0e790-54a8-4d22-9263-9014ab8a37b0', 'volume_size': 1} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712846705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb0e790-54a8-4d22-9263-9014ab8a37b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:07Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Creating volume deb0e790-54a8-4d22-9263-9014ab8a37b0 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:07 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:07 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 1073741824 Jul 15 18:48:07 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:07 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 1073741824" returned: 0 in 0.569s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:07 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 Jul 15 18:48:07 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:08 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0" returned: 0 in 0.375s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:08 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ab754e-b050-46bd-b69b-4664dc0da470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb0e790-54a8-4d22-9263-9014ab8a37b0', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0a2544-722e-45a4-badf-4ab0f59c82c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:08 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Volume volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 (deb0e790-54a8-4d22-9263-9014ab8a37b0): created successfully Jul 15 18:48:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0a2544-722e-45a4-badf-4ab0f59c82c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (7e7aacd4-6c1e-437b-ad13-52ea0b5242fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:08 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-350dfbc0-7bef-4217-a0ab-fce550bd2774 tempest-ProjectMemberTests-529349186 None] Created volume successfully. Jul 15 18:48:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] Creating offline snapshot 2de53b61-957b-4697-ab98-74adb68b1f95 of volume deb0e790-54a8-4d22-9263-9014ab8a37b0 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:09 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cf2b0a-eaff-4dc2-a5cd-0e7aa43d3bff]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:09 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 Jul 15 18:48:09 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:09 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0" returned: 0 in 0.466s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:09 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 1G Jul 15 18:48:09 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:10 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Flow 'volume_create_manager' (25bceb8b-0b95-438c-9d91-bed6ec1eb78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1f9af6-2614-4619-aa11-9994684c6b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 1G" returned: 0 in 0.584s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1f9af6-2614-4619-aa11-9994684c6b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781695560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a028e4-5d78-4ca3-94f1-5bed5fe2eede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e7f323782b4cdca59dcc009c1ee5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:10Z,use_quota=True,user_id='bcfd71c43910463fa6a098bdb4a7fb7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:10 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 Jul 15 18:48:10 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85311d7b-7c0a-4c02-ac63-003d383212f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85311d7b-7c0a-4c02-ac63-003d383212f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba40022-3d4a-45f8-87e4-4a8748033f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba40022-3d4a-45f8-87e4-4a8748033f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a028e4-5d78-4ca3-94f1-5bed5fe2eede', 'volume_name': 'volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220f2c1e-7490-4810-a15f-2c126fff3499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220f2c1e-7490-4810-a15f-2c126fff3499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0700fcd3-8450-42bb-816d-ef6f3fd46969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:10 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Volume 82a028e4-5d78-4ca3-94f1-5bed5fe2eede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede', 'volume_size': 1} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:10 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95" returned: 0 in 0.368s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:10 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 is being set with open permissions: ugo+rw Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:10 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 Jul 15 18:48:10 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Flow 'volume_create_manager' (ecd19ecd-e2cd-43b3-98a0-410388c3c240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca19da6f-3a7f-455d-8af0-2b1b8f0fbd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca19da6f-3a7f-455d-8af0-2b1b8f0fbd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403948616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c52a3b-8ddb-446d-9103-5916ad9c5906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5437fd274c3a46259dc11d3e5402fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:11Z,use_quota=True,user_id='be77bfc0257d495eadf60aa7ba9dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05040872-ca9c-4fc1-930a-d1856eeb3381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05040872-ca9c-4fc1-930a-d1856eeb3381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7ae311-2058-4f67-9920-ff4a9dffbd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7ae311-2058-4f67-9920-ff4a9dffbd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c52a3b-8ddb-446d-9103-5916ad9c5906', 'volume_name': 'volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01665726-76cc-4bae-8837-df0a80c5f0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01665726-76cc-4bae-8837-df0a80c5f0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f22415-1181-479a-a671-9230606248fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:10 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume a2c52a3b-8ddb-446d-9103-5916ad9c5906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906', 'volume_size': 1} Jul 15 18:48:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:11 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95" returned: 0 in 0.308s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:11 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.info Jul 15 18:48:11 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0b36d244-60d7-438c-aba5-d68ed75a4e8c tempest-ProjectAdminTests-2014214504 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5915908813477, 'free_capacity_gb': 1775.5915908813477, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87217) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 15 18:48:11 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.info" returned: 0 in 0.295s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:11 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.info is being set with open permissions: ugo+rw Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:11 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.info Jul 15 18:48:11 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:11 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.info" returned: 0 in 0.264s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781695560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a028e4-5d78-4ca3-94f1-5bed5fe2eede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e7f323782b4cdca59dcc009c1ee5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:10Z,use_quota=True,user_id='bcfd71c43910463fa6a098bdb4a7fb7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Creating volume 82a028e4-5d78-4ca3-94f1-5bed5fe2eede {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:11 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:11 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede 1073741824 Jul 15 18:48:11 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:11 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c28f6324-da2f-4650-8922-1ee32376b3d6 tempest-ProjectMemberTests-529349186 None] Create snapshot completed successfully Jul 15 18:48:12 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede 1073741824" returned: 0 in 0.467s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:12 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede Jul 15 18:48:12 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:12 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede" returned: 0 in 0.252s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.428s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403948616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c52a3b-8ddb-446d-9103-5916ad9c5906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5437fd274c3a46259dc11d3e5402fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:11Z,use_quota=True,user_id='be77bfc0257d495eadf60aa7ba9dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Creating volume a2c52a3b-8ddb-446d-9103-5916ad9c5906 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:12 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-2de53b61-957b-4697-ab98-74adb68b1f95-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:12 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906 1073741824 Jul 15 18:48:12 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0700fcd3-8450-42bb-816d-ef6f3fd46969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394e1eab-73b2-49ab-a174-ab1b09473f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Lock "cinder-2de53b61-957b-4697-ab98-74adb68b1f95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-deb0e790-54a8-4d22-9263-9014ab8a37b0" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:12 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Volume volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede (82a028e4-5d78-4ca3-94f1-5bed5fe2eede): created successfully Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394e1eab-73b2-49ab-a174-ab1b09473f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Flow 'volume_create_manager' (25bceb8b-0b95-438c-9d91-bed6ec1eb78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-deb0e790-54a8-4d22-9263-9014ab8a37b0" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-2de53b61-957b-4697-ab98-74adb68b1f95" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:12 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c9752963-1e8d-43e3-97a4-a9c4c45bb2da tempest-ProjectReaderTests-305041348 None] Created volume successfully. Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-2de53b61-957b-4697-ab98-74adb68b1f95" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Deleting offline snapshot 2de53b61-957b-4697-ab98-74adb68b1f95 of volume deb0e790-54a8-4d22-9263-9014ab8a37b0 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] snapshot_file for this snap is: volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ba9c60-e8fe-41c3-907a-65ee0174d0f1]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:12 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 Jul 15 18:48:12 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:12 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906 1073741824" returned: 0 in 0.585s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:13 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906 Jul 15 18:48:13 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:13 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95" returned: 0 in 0.471s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deb0e790-54a8-4d22-9263-9014ab8a37b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[72131eec-ef75-41d5-a19d-26605481bdcc]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:13 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 Jul 15 18:48:13 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:13 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906" returned: 0 in 0.289s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f22415-1181-479a-a671-9230606248fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8f0638-5121-43e8-95d0-fffca2a41b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:13 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906 (a2c52a3b-8ddb-446d-9103-5916ad9c5906): created successfully Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8f0638-5121-43e8-95d0-fffca2a41b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Flow 'volume_create_manager' (ecd19ecd-e2cd-43b3-98a0-410388c3c240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:13 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-08d0bcba-0bba-4fd8-9f02-5802a3ab9e53 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Created volume successfully. Jul 15 18:48:13 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0" returned: 0 in 0.432s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:13 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 Jul 15 18:48:13 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Acquiring lock "cinder-82a028e4-5d78-4ca3-94f1-5bed5fe2eede-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Lock "cinder-82a028e4-5d78-4ca3-94f1-5bed5fe2eede-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Acquiring lock "cinder-quobyte-82a028e4-5d78-4ca3-94f1-5bed5fe2eede" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Lock "cinder-quobyte-82a028e4-5d78-4ca3-94f1-5bed5fe2eede" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[91998bff-1c62-4443-b783-56c0e1967cf4]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:13 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede Jul 15 18:48:13 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:13 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95" returned: 0 in 0.419s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:14 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95 Jul 15 18:48:14 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:14 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede" returned: 0 in 0.421s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:14 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede Jul 15 18:48:14 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:14 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0.2de53b61-957b-4697-ab98-74adb68b1f95" returned: 0 in 0.300s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-2de53b61-957b-4697-ab98-74adb68b1f95" released by "_delete_snapshot" :: held 1.773s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-deb0e790-54a8-4d22-9263-9014ab8a37b0" released by "delete_snapshot" :: held 1.827s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Created reservations ['3ece0c1c-197e-4dc2-8d53-fbc835b125c0', '41aaa2db-a9f0-482b-9fe1-6c4932d3b3a8', '89f92f9c-c243-4446-87e4-446a80d30163', 'b1cb00d2-8ece-487f-90ee-3d44431d2d23'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:14 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Delete snapshot completed successfully. Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7220a42d-38d9-4e79-b0c5-60751336bde0 tempest-ProjectMemberTests-529349186 None] Lock "cinder-2de53b61-957b-4697-ab98-74adb68b1f95-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:14 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-82a028e4-5d78-4ca3-94f1-5bed5fe2eede" returned: 0 in 0.347s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Lock "cinder-quobyte-82a028e4-5d78-4ca3-94f1-5bed5fe2eede" released by "delete_volume" :: held 0.821s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Created reservations ['ed2846c1-a625-4cf2-9b6f-373ec330e18f', '67fb041a-04e3-49c8-bfc3-38a95f5f5fc3', '109b27e1-1293-4bb2-a2be-83970df9ebbd', '6508f5b0-8f8a-48ff-9938-3cfc102af131'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-deb0e790-54a8-4d22-9263-9014ab8a37b0-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Flow 'volume_create_manager' (3be0e9c5-aa0e-4855-a32f-e09d235af0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6705f2-0a4e-4532-8f8b-346d5c07d073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6705f2-0a4e-4532-8f8b-346d5c07d073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-235606452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0a182e-9197-4b02-9554-43086c7c4d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5437fd274c3a46259dc11d3e5402fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:15Z,use_quota=True,user_id='be77bfc0257d495eadf60aa7ba9dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ec3c01-2c21-4e66-8a66-f87f63c5c545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ec3c01-2c21-4e66-8a66-f87f63c5c545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bd7e51-08fd-4633-8052-580deec09c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bd7e51-08fd-4633-8052-580deec09c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e0a182e-9197-4b02-9554-43086c7c4d13', 'volume_name': 'volume-1e0a182e-9197-4b02-9554-43086c7c4d13', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7843b9dd-6f2f-470b-8ace-13cac78f0559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7843b9dd-6f2f-470b-8ace-13cac78f0559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12661d7-ded7-42ea-a586-760c7af70e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:14 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume 1e0a182e-9197-4b02-9554-43086c7c4d13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e0a182e-9197-4b02-9554-43086c7c4d13', 'volume_size': 1} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-235606452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0a182e-9197-4b02-9554-43086c7c4d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5437fd274c3a46259dc11d3e5402fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:15Z,use_quota=True,user_id='be77bfc0257d495eadf60aa7ba9dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Creating volume 1e0a182e-9197-4b02-9554-43086c7c4d13 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:14 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1e0a182e-9197-4b02-9554-43086c7c4d13 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Lock "cinder-deb0e790-54a8-4d22-9263-9014ab8a37b0-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:14 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1e0a182e-9197-4b02-9554-43086c7c4d13 1073741824 Jul 15 18:48:14 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-deb0e790-54a8-4d22-9263-9014ab8a37b0" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-deb0e790-54a8-4d22-9263-9014ab8a37b0" acquired by "delete_volume" :: waited 0.097s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:15 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:15 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[66159f00-b25a-4901-933b-4a0c5b6eb290]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:15 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 Jul 15 18:48:15 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Flow 'volume_create_manager' (d8df189a-8f0e-4e1a-bfc0-6e3fa3c0c565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d106d6cc-3856-4cb6-a67b-b79db17c72bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d106d6cc-3856-4cb6-a67b-b79db17c72bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-61030009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74e150a-c984-4a88-85d8-e7dea082171d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5437fd274c3a46259dc11d3e5402fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:15Z,use_quota=True,user_id='be77bfc0257d495eadf60aa7ba9dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c685c0-1de7-4e6a-a6d9-1ede9759b66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c685c0-1de7-4e6a-a6d9-1ede9759b66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:15 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa68c6cf-ca57-4aee-a652-48edf0fa10d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa68c6cf-ca57-4aee-a652-48edf0fa10d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c74e150a-c984-4a88-85d8-e7dea082171d', 'volume_name': 'volume-c74e150a-c984-4a88-85d8-e7dea082171d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffebeb0a-634c-4cd4-a3a4-b67d5378210d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffebeb0a-634c-4cd4-a3a4-b67d5378210d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (336cbe49-2077-4334-8735-0095843230ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:15 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume c74e150a-c984-4a88-85d8-e7dea082171d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c74e150a-c984-4a88-85d8-e7dea082171d', 'volume_size': 1} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.516s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:15 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Deleted volume successfully. Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4a236fb2-ca60-4707-bf47-317375e187c5 tempest-ProjectReaderTests-305041348 None] Lock "cinder-82a028e4-5d78-4ca3-94f1-5bed5fe2eede-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:15 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0" returned: 0 in 0.575s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:15 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1e0a182e-9197-4b02-9554-43086c7c4d13 1073741824" returned: 0 in 0.874s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:15 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0 Jul 15 18:48:15 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1e0a182e-9197-4b02-9554-43086c7c4d13 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:15 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1e0a182e-9197-4b02-9554-43086c7c4d13 Jul 15 18:48:15 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:16 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-deb0e790-54a8-4d22-9263-9014ab8a37b0" returned: 0 in 0.403s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-deb0e790-54a8-4d22-9263-9014ab8a37b0" released by "delete_volume" :: held 1.118s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:16 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1e0a182e-9197-4b02-9554-43086c7c4d13" returned: 0 in 0.369s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-61030009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74e150a-c984-4a88-85d8-e7dea082171d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5437fd274c3a46259dc11d3e5402fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:15Z,use_quota=True,user_id='be77bfc0257d495eadf60aa7ba9dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Creating volume c74e150a-c984-4a88-85d8-e7dea082171d {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:16 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c74e150a-c984-4a88-85d8-e7dea082171d 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:16 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c74e150a-c984-4a88-85d8-e7dea082171d 1073741824 Jul 15 18:48:16 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12661d7-ded7-42ea-a586-760c7af70e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e0a182e-9197-4b02-9554-43086c7c4d13', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685535d8-4c4c-41fe-8bf3-bb4adc8f286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:16 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume volume-1e0a182e-9197-4b02-9554-43086c7c4d13 (1e0a182e-9197-4b02-9554-43086c7c4d13): created successfully Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685535d8-4c4c-41fe-8bf3-bb4adc8f286f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Flow 'volume_create_manager' (3be0e9c5-aa0e-4855-a32f-e09d235af0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Flow 'volume_create_manager' (980f9ab9-26b3-4c62-8401-b3ae80b88e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4aa021a-8f94-49d3-9cfc-9f8cfc9117fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4aa021a-8f94-49d3-9cfc-9f8cfc9117fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352379101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851e7835-4e9e-46bd-a0ed-9f4b580baae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65819e7e0434e75b5763d766ec01872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:16Z,use_quota=True,user_id='a721f65ba8e44bf1ba2f0f8c39805f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af874c2e-e51a-4d45-8abc-7a4784627b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af874c2e-e51a-4d45-8abc-7a4784627b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7092a00a-7e76-4f2f-ac62-5941ff628a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7092a00a-7e76-4f2f-ac62-5941ff628a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '851e7835-4e9e-46bd-a0ed-9f4b580baae0', 'volume_name': 'volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a007519c-206d-4ce3-b033-18a0a81d16d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a007519c-206d-4ce3-b033-18a0a81d16d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f02270-5872-4ddd-acc6-65a3c039737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:16 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Volume 851e7835-4e9e-46bd-a0ed-9f4b580baae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0', 'volume_size': 1} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:16 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-05f25811-2feb-40cb-862a-6436f339591e tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Created volume successfully. Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Created reservations ['5430550f-1fa7-4ea1-9de0-3f299ec2798b', 'e89680c3-ae08-46ef-a689-84a6c7d2cd86', '0a6a2890-8042-47a1-9eb7-1df959edb8a9', '9218011b-2a72-40ae-bfa0-1aa360efa359'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:16 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:16 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:16 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.288s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:16 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Deleted volume successfully. Jul 15 18:48:16 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c74e150a-c984-4a88-85d8-e7dea082171d 1073741824" returned: 0 in 0.639s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-8032cec7-15a2-4eca-9eb6-a32a34ad168f tempest-ProjectMemberTests-529349186 None] Lock "cinder-deb0e790-54a8-4d22-9263-9014ab8a37b0-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c74e150a-c984-4a88-85d8-e7dea082171d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:16 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c74e150a-c984-4a88-85d8-e7dea082171d Jul 15 18:48:16 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Flow 'volume_create_manager' (ea072f86-1998-4983-9356-9e14e117a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb9bce8-0d23-48ba-be7a-283a2602a911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb9bce8-0d23-48ba-be7a-283a2602a911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1819306772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb971113-038c-45e4-ac8b-cf3a09b5c253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5437fd274c3a46259dc11d3e5402fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:17Z,use_quota=True,user_id='be77bfc0257d495eadf60aa7ba9dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2897fe-29ac-4ca5-a7b6-8403bfaf79a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2897fe-29ac-4ca5-a7b6-8403bfaf79a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca116393-0753-4126-83e4-1398db8a9968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca116393-0753-4126-83e4-1398db8a9968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb971113-038c-45e4-ac8b-cf3a09b5c253', 'volume_name': 'volume-fb971113-038c-45e4-ac8b-cf3a09b5c253', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a61340-cd8c-443f-9c6f-a832beaea4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a61340-cd8c-443f-9c6f-a832beaea4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49a1c9c-7872-468b-bb8f-bc7ab384867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:16 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume fb971113-038c-45e4-ac8b-cf3a09b5c253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb971113-038c-45e4-ac8b-cf3a09b5c253', 'volume_size': 1} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:16 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Flow 'volume_create_manager' (54971558-d8d3-4d20-9f4a-bea8662f4b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e266a7-5f84-4149-b653-6ab5493c8a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e266a7-5f84-4149-b653-6ab5493c8a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638441717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9043db6-c110-43c6-8523-d2e2d54b2781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e7f323782b4cdca59dcc009c1ee5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:17Z,use_quota=True,user_id='bcfd71c43910463fa6a098bdb4a7fb7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bde70c0-4007-4ae4-809a-e292fe64fbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bde70c0-4007-4ae4-809a-e292fe64fbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9758419e-cef9-4336-b3cb-c986d6775bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9758419e-cef9-4336-b3cb-c986d6775bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9043db6-c110-43c6-8523-d2e2d54b2781', 'volume_name': 'volume-b9043db6-c110-43c6-8523-d2e2d54b2781', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8a2b8c-4dcb-46db-9d93-f1744138fd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8a2b8c-4dcb-46db-9d93-f1744138fd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b7d690-8ed6-40ab-ae25-102e823baa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Volume b9043db6-c110-43c6-8523-d2e2d54b2781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9043db6-c110-43c6-8523-d2e2d54b2781', 'volume_size': 1} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:17 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c74e150a-c984-4a88-85d8-e7dea082171d" returned: 0 in 0.278s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352379101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851e7835-4e9e-46bd-a0ed-9f4b580baae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65819e7e0434e75b5763d766ec01872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:16Z,use_quota=True,user_id='a721f65ba8e44bf1ba2f0f8c39805f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Creating volume 851e7835-4e9e-46bd-a0ed-9f4b580baae0 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:17 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:17 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 1073741824 Jul 15 18:48:17 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Flow 'volume_create_manager' (14bcad91-3319-4c5a-bf71-57848285fac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00148ee-cbea-4a14-9140-0d0d15d9e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (336cbe49-2077-4334-8735-0095843230ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74e150a-c984-4a88-85d8-e7dea082171d', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb804605-0993-4a5d-8cbc-d2dfd192afb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00148ee-cbea-4a14-9140-0d0d15d9e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-739748464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5437fd274c3a46259dc11d3e5402fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:17Z,use_quota=True,user_id='be77bfc0257d495eadf60aa7ba9dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408a8a27-88be-4721-930d-baccb665b6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408a8a27-88be-4721-930d-baccb665b6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1496e649-e946-48d2-9c76-4c4fc1f95ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1496e649-e946-48d2-9c76-4c4fc1f95ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8', 'volume_name': 'volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0a1f3c-e9c9-4f0c-9157-bdca0617945e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0a1f3c-e9c9-4f0c-9157-bdca0617945e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7eedd6-9c3b-4506-b7cc-3fb9018d07d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume 4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8', 'volume_size': 1} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Flow 'volume_create_manager' (686fed85-f86a-46b1-9cb0-9b9055a6ad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3feca05-d639-4982-93a9-1560f906f43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume volume-c74e150a-c984-4a88-85d8-e7dea082171d (c74e150a-c984-4a88-85d8-e7dea082171d): created successfully Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb804605-0993-4a5d-8cbc-d2dfd192afb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Flow 'volume_create_manager' (d8df189a-8f0e-4e1a-bfc0-6e3fa3c0c565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3feca05-d639-4982-93a9-1560f906f43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-982546631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b32e8b3-c0ef-4996-bc53-08aa3da198fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5437fd274c3a46259dc11d3e5402fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:17Z,use_quota=True,user_id='be77bfc0257d495eadf60aa7ba9dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ec7613-6972-4960-83c9-599821a36ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ec7613-6972-4960-83c9-599821a36ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0643c3e8-38fd-41d9-9066-73588dbdbb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0643c3e8-38fd-41d9-9066-73588dbdbb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b32e8b3-c0ef-4996-bc53-08aa3da198fa', 'volume_name': 'volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741c772e-b80e-4d61-8cf5-e59f9ef2a18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741c772e-b80e-4d61-8cf5-e59f9ef2a18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba9fd89-f5ce-492b-9171-502db44a58fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume 1b32e8b3-c0ef-4996-bc53-08aa3da198fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa', 'volume_size': 1} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:17 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9bfe8a66-459b-46cd-8432-10b4c45d6675 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Created volume successfully. Jul 15 18:48:17 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 1073741824" returned: 0 in 0.475s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:17 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 Jul 15 18:48:17 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (8fa5d817-a0a3-483e-a525-0002a7946b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863dc4be-d519-4d5e-959a-2092dbe946bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863dc4be-d519-4d5e-959a-2092dbe946bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-400179445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7d145a-a396-4aef-bb58-1f388e2c8e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:18Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384b8bbb-1bf9-4128-bc09-1a185e68e10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384b8bbb-1bf9-4128-bc09-1a185e68e10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5dc6a1f-f830-4ead-85cd-0e591ca337aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5dc6a1f-f830-4ead-85cd-0e591ca337aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f7d145a-a396-4aef-bb58-1f388e2c8e79', 'volume_name': 'volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c542fc1-82bf-40dd-b617-29e2092c687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c542fc1-82bf-40dd-b617-29e2092c687c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6004af7-04ef-40d4-ba61-433e79728626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Volume 0f7d145a-a396-4aef-bb58-1f388e2c8e79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79', 'volume_size': 1} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:17 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0" returned: 0 in 0.298s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.978s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1819306772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb971113-038c-45e4-ac8b-cf3a09b5c253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5437fd274c3a46259dc11d3e5402fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:17Z,use_quota=True,user_id='be77bfc0257d495eadf60aa7ba9dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Creating volume fb971113-038c-45e4-ac8b-cf3a09b5c253 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:17 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fb971113-038c-45e4-ac8b-cf3a09b5c253 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f02270-5872-4ddd-acc6-65a3c039737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d16009-1bc3-493b-8db6-a90e034c6082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:17 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fb971113-038c-45e4-ac8b-cf3a09b5c253 1073741824 Jul 15 18:48:17 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:17 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Volume volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 (851e7835-4e9e-46bd-a0ed-9f4b580baae0): created successfully Jul 15 18:48:17 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d16009-1bc3-493b-8db6-a90e034c6082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Flow 'volume_create_manager' (980f9ab9-26b3-4c62-8401-b3ae80b88e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:18 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-441531c7-07a1-4525-a777-3fd66a61a08b tempest-ProjectReaderTests-1365279000 None] Created volume successfully. Jul 15 18:48:18 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fb971113-038c-45e4-ac8b-cf3a09b5c253 1073741824" returned: 0 in 0.424s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fb971113-038c-45e4-ac8b-cf3a09b5c253 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:18 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fb971113-038c-45e4-ac8b-cf3a09b5c253 Jul 15 18:48:18 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:18 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fb971113-038c-45e4-ac8b-cf3a09b5c253" returned: 0 in 0.247s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.562s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638441717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9043db6-c110-43c6-8523-d2e2d54b2781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e7f323782b4cdca59dcc009c1ee5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:17Z,use_quota=True,user_id='bcfd71c43910463fa6a098bdb4a7fb7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Creating volume b9043db6-c110-43c6-8523-d2e2d54b2781 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:18 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9043db6-c110-43c6-8523-d2e2d54b2781 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:18 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9043db6-c110-43c6-8523-d2e2d54b2781 1073741824 Jul 15 18:48:18 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49a1c9c-7872-468b-bb8f-bc7ab384867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb971113-038c-45e4-ac8b-cf3a09b5c253', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee98bf81-4b2c-4e63-af69-f7046f2d5e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:18 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume volume-fb971113-038c-45e4-ac8b-cf3a09b5c253 (fb971113-038c-45e4-ac8b-cf3a09b5c253): created successfully Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee98bf81-4b2c-4e63-af69-f7046f2d5e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:18 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Flow 'volume_create_manager' (ea072f86-1998-4983-9356-9e14e117a415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:18 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e1dcef64-078d-420b-b7dc-d745eb51d594 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Created volume successfully. Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:19 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9043db6-c110-43c6-8523-d2e2d54b2781 1073741824" returned: 0 in 0.463s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9043db6-c110-43c6-8523-d2e2d54b2781 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:19 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9043db6-c110-43c6-8523-d2e2d54b2781 Jul 15 18:48:19 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:19 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9043db6-c110-43c6-8523-d2e2d54b2781" returned: 0 in 0.241s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.155s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-739748464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5437fd274c3a46259dc11d3e5402fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:17Z,use_quota=True,user_id='be77bfc0257d495eadf60aa7ba9dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Creating volume 4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:19 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b7d690-8ed6-40ab-ae25-102e823baa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9043db6-c110-43c6-8523-d2e2d54b2781', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8032940-78c8-429d-bb22-7e715af23eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:19 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8 1073741824 Jul 15 18:48:19 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:19 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Volume volume-b9043db6-c110-43c6-8523-d2e2d54b2781 (b9043db6-c110-43c6-8523-d2e2d54b2781): created successfully Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8032940-78c8-429d-bb22-7e715af23eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Flow 'volume_create_manager' (54971558-d8d3-4d20-9f4a-bea8662f4b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:19 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1fc7e2dd-f469-4b3b-a163-c5682e324bde tempest-ProjectReaderTests-305041348 None] Created volume successfully. Jul 15 18:48:19 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8 1073741824" returned: 0 in 0.416s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:19 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8 Jul 15 18:48:19 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:20 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8" returned: 0 in 0.253s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.777s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-982546631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b32e8b3-c0ef-4996-bc53-08aa3da198fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5437fd274c3a46259dc11d3e5402fd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:17Z,use_quota=True,user_id='be77bfc0257d495eadf60aa7ba9dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Creating volume 1b32e8b3-c0ef-4996-bc53-08aa3da198fa {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:20 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:20 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa 1073741824 Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7eedd6-9c3b-4506-b7cc-3fb9018d07d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:20 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b19d6f-9d50-47a1-ace5-db517d10ea31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:20 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8 (4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8): created successfully Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b19d6f-9d50-47a1-ace5-db517d10ea31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Flow 'volume_create_manager' (14bcad91-3319-4c5a-bf71-57848285fac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:20 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-40fefee9-a64c-4cab-950e-ffa486668d99 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Created volume successfully. Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Acquiring lock "cinder-b9043db6-c110-43c6-8523-d2e2d54b2781-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Lock "cinder-b9043db6-c110-43c6-8523-d2e2d54b2781-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:20 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa 1073741824" returned: 0 in 0.482s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Acquiring lock "cinder-quobyte-b9043db6-c110-43c6-8523-d2e2d54b2781" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Lock "cinder-quobyte-b9043db6-c110-43c6-8523-d2e2d54b2781" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:20 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa Jul 15 18:48:20 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc247e30-a52d-4861-ab67-566b2949dfdb]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9043db6-c110-43c6-8523-d2e2d54b2781 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:20 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9043db6-c110-43c6-8523-d2e2d54b2781 Jul 15 18:48:20 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:20 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa" returned: 0 in 0.258s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.093s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-400179445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7d145a-a396-4aef-bb58-1f388e2c8e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:18Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Creating volume 0f7d145a-a396-4aef-bb58-1f388e2c8e79 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:20 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba9fd89-f5ce-492b-9171-502db44a58fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4b8a2b-baf9-4dfb-a3bb-2bdbbdc557a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:20 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 1073741824 Jul 15 18:48:20 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:20 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Volume volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa (1b32e8b3-c0ef-4996-bc53-08aa3da198fa): created successfully Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4b8a2b-baf9-4dfb-a3bb-2bdbbdc557a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Flow 'volume_create_manager' (686fed85-f86a-46b1-9cb0-9b9055a6ad32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:20 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0fa787fd-6f0a-496d-adeb-f237de62794c tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Created volume successfully. Jul 15 18:48:21 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9043db6-c110-43c6-8523-d2e2d54b2781" returned: 0 in 0.384s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9043db6-c110-43c6-8523-d2e2d54b2781 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:21 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9043db6-c110-43c6-8523-d2e2d54b2781 Jul 15 18:48:21 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "cinder-1b32e8b3-c0ef-4996-bc53-08aa3da198fa-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-1b32e8b3-c0ef-4996-bc53-08aa3da198fa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "cinder-quobyte-1b32e8b3-c0ef-4996-bc53-08aa3da198fa" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-quobyte-1b32e8b3-c0ef-4996-bc53-08aa3da198fa" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[05495bdf-5eec-4726-b0ac-1fc2669be5dd]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:21 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b9043db6-c110-43c6-8523-d2e2d54b2781" returned: 0 in 0.295s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Lock "cinder-quobyte-b9043db6-c110-43c6-8523-d2e2d54b2781" released by "delete_volume" :: held 0.724s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=275,cinder:SELECT=194,cinder:INSERT=67,cinder:DELETE=25 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:48:21 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa Jul 15 18:48:21 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:21 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 1073741824" returned: 0 in 0.517s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Created reservations ['a0e850a9-3f68-44ce-8573-b354f30179ae', 'c6b9a20c-b82c-4369-8aa6-2327da2b82a1', '727a8ed9-109f-48ed-975a-cc1f2962a731', 'ddaf9668-3ded-4441-8df5-3311487d9d63'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:21 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 Jul 15 18:48:21 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:21 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:21 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:21 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa" returned: 0 in 0.451s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:21 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79" returned: 0 in 0.285s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.689s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=223,cinder:UPDATE=275,cinder:DELETE=26,cinder:INSERT=75 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:48:21 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa Jul 15 18:48:21 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6004af7-04ef-40d4-ba61-433e79728626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d853af-2734-4464-abbf-ece08ca855ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] Creating offline snapshot 33ccdcec-1d44-42b2-ac5e-27225fb234be of volume 851e7835-4e9e-46bd-a0ed-9f4b580baae0 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:21 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.289s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:21 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Volume volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 (0f7d145a-a396-4aef-bb58-1f388e2c8e79): created successfully Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d853af-2734-4464-abbf-ece08ca855ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (8fa5d817-a0a3-483e-a525-0002a7946b77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04a6c67-c5db-4bbe-b4b2-d1c4534e362a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:21 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Deleted volume successfully. Jul 15 18:48:21 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-cf8edc77-2814-4ed7-bbd7-95220afad3ae tempest-ProjectMemberTests-529349186 None] Created volume successfully. Jul 15 18:48:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2e2a913d-66b4-48f2-a586-9670d313520c tempest-ProjectReaderTests-305041348 None] Lock "cinder-b9043db6-c110-43c6-8523-d2e2d54b2781-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:21 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 Jul 15 18:48:21 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:22 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1b32e8b3-c0ef-4996-bc53-08aa3da198fa" returned: 0 in 0.345s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-quobyte-1b32e8b3-c0ef-4996-bc53-08aa3da198fa" released by "delete_volume" :: held 0.843s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Created reservations ['1d277eac-5f5c-4904-a626-d9c33a8b0e7e', 'c8e3f357-4116-4861-b09a-dbcdf1f0c56b', '11387629-98cd-4b36-b7ce-32c2fc48ef82', 'a5c50716-16c0-474e-afab-e432d24bc5d0'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:22 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0" returned: 0 in 0.408s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:22 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:22 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:22 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be 1G Jul 15 18:48:22 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "cinder-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "cinder-quobyte-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-quobyte-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8" acquired by "delete_volume" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a824e3-34c2-4b4a-8574-4d9b1b6882e5]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:22 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.360s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:22 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Deleted volume successfully. Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aa7c523a-2910-4666-8b4f-142a85969256 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-1b32e8b3-c0ef-4996-bc53-08aa3da198fa-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:22 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8 Jul 15 18:48:22 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:22 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be 1G" returned: 0 in 0.504s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:22 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be Jul 15 18:48:22 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:22 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8" returned: 0 in 0.442s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:23 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8 Jul 15 18:48:23 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:23 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be" returned: 0 in 0.356s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:23 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be is being set with open permissions: ugo+rw Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:23 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be Jul 15 18:48:23 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:23 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8" returned: 0 in 0.319s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-quobyte-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8" released by "delete_volume" :: held 0.836s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Created reservations ['bc28a237-008a-44c3-a69d-a7d6ba95a392', '1997a0ea-4486-4c3b-a168-725668695d75', '781c6703-9a71-4c51-890c-30876cfbfbab', '38db38fa-f056-436a-9d91-60d0304bfad7'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:23 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be" returned: 0 in 0.299s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:23 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.info Jul 15 18:48:23 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:23 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:23 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "cinder-fb971113-038c-45e4-ac8b-cf3a09b5c253-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-fb971113-038c-45e4-ac8b-cf3a09b5c253-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "cinder-quobyte-fb971113-038c-45e4-ac8b-cf3a09b5c253" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-quobyte-fb971113-038c-45e4-ac8b-cf3a09b5c253" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:23 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.info" returned: 0 in 0.328s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:23 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.info is being set with open permissions: ugo+rw Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bcb6f2-7dab-467f-ac12-345c12f7032f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fb971113-038c-45e4-ac8b-cf3a09b5c253 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:23 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.info Jul 15 18:48:23 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:23 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fb971113-038c-45e4-ac8b-cf3a09b5c253 Jul 15 18:48:23 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:23 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.403s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:23 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:23 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Deleted volume successfully. Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-abc3836c-af69-41a4-972a-db27e960c90b tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-4ad3a76b-6dde-4d15-9ed6-0b9b2aaaa1f8-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:24 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.info" returned: 0 in 0.318s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.376s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.608s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] Creating offline snapshot 5d8466c1-f398-4aa0-8fec-a22531cac219 of volume 0f7d145a-a396-4aef-bb58-1f388e2c8e79 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c7dc92-e26a-4e6f-b21b-90517e849035]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:24 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4eb892fb-70b0-4607-a658-49ccb4a083e8 tempest-ProjectReaderTests-1365279000 None] Create snapshot completed successfully Jul 15 18:48:24 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fb971113-038c-45e4-ac8b-cf3a09b5c253" returned: 0 in 0.472s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fb971113-038c-45e4-ac8b-cf3a09b5c253 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:24 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 Jul 15 18:48:24 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:24 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fb971113-038c-45e4-ac8b-cf3a09b5c253 Jul 15 18:48:24 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:24 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-fb971113-038c-45e4-ac8b-cf3a09b5c253" returned: 0 in 0.294s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-quobyte-fb971113-038c-45e4-ac8b-cf3a09b5c253" released by "delete_volume" :: held 0.834s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:24 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-33ccdcec-1d44-42b2-ac5e-27225fb234be-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79" returned: 0 in 0.446s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Lock "cinder-33ccdcec-1d44-42b2-ac5e-27225fb234be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-851e7835-4e9e-46bd-a0ed-9f4b580baae0" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:24 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 1G Jul 15 18:48:24 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-851e7835-4e9e-46bd-a0ed-9f4b580baae0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-33ccdcec-1d44-42b2-ac5e-27225fb234be" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-33ccdcec-1d44-42b2-ac5e-27225fb234be" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Deleting offline snapshot 33ccdcec-1d44-42b2-ac5e-27225fb234be of volume 851e7835-4e9e-46bd-a0ed-9f4b580baae0 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] snapshot_file for this snap is: volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Created reservations ['be35a308-7d64-4316-83a9-72b7015da20a', '3d35b074-3a72-4475-84a2-8fd656659494', 'db1e9738-05a1-4c45-825a-16da47803322', 'c394e70b-70b4-411f-b817-ac3cdfe1000f'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7f7b59-d3ff-486c-a52c-c8fe5be3afc9]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:24 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:24 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:24 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be Jul 15 18:48:24 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "cinder-c74e150a-c984-4a88-85d8-e7dea082171d-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-c74e150a-c984-4a88-85d8-e7dea082171d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "cinder-quobyte-c74e150a-c984-4a88-85d8-e7dea082171d" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-quobyte-c74e150a-c984-4a88-85d8-e7dea082171d" acquired by "delete_volume" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfba0b2c-1bd5-4674-bb54-4d04c64c848b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c74e150a-c984-4a88-85d8-e7dea082171d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:25 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:25 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.369s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 1G" returned: 0 in 0.621s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:25 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Deleted volume successfully. Jul 15 18:48:25 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 Jul 15 18:48:25 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2e2eb1a7-cf89-46a5-ae49-8c3774b57661 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-fb971113-038c-45e4-ac8b-cf3a09b5c253-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:25 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c74e150a-c984-4a88-85d8-e7dea082171d Jul 15 18:48:25 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:25 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be" returned: 0 in 0.590s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03b46ee-c50e-4e01-a816-1643c3fcc51f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:25 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 Jul 15 18:48:25 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:25 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219" returned: 0 in 0.364s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:25 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 is being set with open permissions: ugo+rw Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:25 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c74e150a-c984-4a88-85d8-e7dea082171d" returned: 0 in 0.479s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c74e150a-c984-4a88-85d8-e7dea082171d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:25 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 Jul 15 18:48:25 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:25 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c74e150a-c984-4a88-85d8-e7dea082171d Jul 15 18:48:25 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:25 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0" returned: 0 in 0.424s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:25 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be Jul 15 18:48:25 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:25 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219" returned: 0 in 0.302s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:25 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-c74e150a-c984-4a88-85d8-e7dea082171d" returned: 0 in 0.305s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-quobyte-c74e150a-c984-4a88-85d8-e7dea082171d" released by "delete_volume" :: held 0.851s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:26 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.info Jul 15 18:48:26 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Created reservations ['7b5c662a-6f26-42e9-a54c-4d0b8d6c06b7', '1d01ecc8-edd7-45e9-a985-b8609c538aaf', '42073493-8c4f-42b5-b072-fea6a3b638dc', '2a63ed3a-39c3-41d5-85ba-084241f7b6c7'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:26 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:26 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "cinder-1e0a182e-9197-4b02-9554-43086c7c4d13-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-1e0a182e-9197-4b02-9554-43086c7c4d13-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "cinder-quobyte-1e0a182e-9197-4b02-9554-43086c7c4d13" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:26 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be" returned: 0 in 0.508s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-quobyte-1e0a182e-9197-4b02-9554-43086c7c4d13" acquired by "delete_volume" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:26 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be Jul 15 18:48:26 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[1136c680-9ca9-40c5-8ae0-976a753e7768]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1e0a182e-9197-4b02-9554-43086c7c4d13 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:26 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.info" returned: 0 in 0.440s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:26 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.info is being set with open permissions: ugo+rw Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:26 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.info Jul 15 18:48:26 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:26 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.378s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:26 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Deleted volume successfully. Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-aa9aa38e-3145-4165-bf0f-a0d261bdb1a8 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-c74e150a-c984-4a88-85d8-e7dea082171d-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:26 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1e0a182e-9197-4b02-9554-43086c7c4d13 Jul 15 18:48:26 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:26 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0.33ccdcec-1d44-42b2-ac5e-27225fb234be" returned: 0 in 0.295s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-33ccdcec-1d44-42b2-ac5e-27225fb234be" released by "_delete_snapshot" :: held 1.953s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-851e7835-4e9e-46bd-a0ed-9f4b580baae0" released by "delete_snapshot" :: held 1.989s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Created reservations ['809b55c3-1d5f-4a37-b669-d7aa4b3c90ae', '3ea409de-f5cd-4ffa-ad7a-06491d7ab25d', '195bc639-62a9-4cc9-aaf5-58123c2a69f3', 'cbfb6930-5d16-4e33-9f03-7ced6bfa2633'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:26 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.info" returned: 0 in 0.375s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.663s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:26 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4667aaf0-cc51-41aa-8c5b-9e45aed1e01c tempest-ProjectMemberTests-529349186 None] Create snapshot completed successfully Jul 15 18:48:26 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Delete snapshot completed successfully. Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5fa31d7b-a273-4c8c-a9f2-7172ba88ae5e tempest-ProjectReaderTests-1365279000 None] Lock "cinder-33ccdcec-1d44-42b2-ac5e-27225fb234be-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:26 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1e0a182e-9197-4b02-9554-43086c7c4d13" returned: 0 in 0.555s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1e0a182e-9197-4b02-9554-43086c7c4d13 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:26 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1e0a182e-9197-4b02-9554-43086c7c4d13 Jul 15 18:48:26 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:27 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1e0a182e-9197-4b02-9554-43086c7c4d13" returned: 0 in 0.247s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-quobyte-1e0a182e-9197-4b02-9554-43086c7c4d13" released by "delete_volume" :: held 0.856s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Created reservations ['e6ccd324-fa09-48dd-ac70-805f771dcdc0', 'b3e446e4-0d8c-4067-9cc9-4387f0363f93', '206f3984-4fd6-47d0-bac9-127bf2467b0f', '98b333b0-bbd6-4278-9956-3b021791a911'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:27 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:27 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "cinder-a2c52a3b-8ddb-446d-9103-5916ad9c5906-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-a2c52a3b-8ddb-446d-9103-5916ad9c5906-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "cinder-quobyte-a2c52a3b-8ddb-446d-9103-5916ad9c5906" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-quobyte-a2c52a3b-8ddb-446d-9103-5916ad9c5906" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0ca337-30c2-416b-a54f-485602a5e41a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:27 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.327s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:27 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Deleted volume successfully. Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a14bf48a-37b1-4a50-9065-a416578931a6 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-1e0a182e-9197-4b02-9554-43086c7c4d13-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:27 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906 Jul 15 18:48:27 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-5d8466c1-f398-4aa0-8fec-a22531cac219-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Lock "cinder-5d8466c1-f398-4aa0-8fec-a22531cac219-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-0f7d145a-a396-4aef-bb58-1f388e2c8e79" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-0f7d145a-a396-4aef-bb58-1f388e2c8e79" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-5d8466c1-f398-4aa0-8fec-a22531cac219" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-5d8466c1-f398-4aa0-8fec-a22531cac219" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Deleting offline snapshot 5d8466c1-f398-4aa0-8fec-a22531cac219 of volume 0f7d145a-a396-4aef-bb58-1f388e2c8e79 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] snapshot_file for this snap is: volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-851e7835-4e9e-46bd-a0ed-9f4b580baae0-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[76feb8aa-fe14-4688-97a2-4f4ac0b6ef21]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-851e7835-4e9e-46bd-a0ed-9f4b580baae0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-851e7835-4e9e-46bd-a0ed-9f4b580baae0" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-851e7835-4e9e-46bd-a0ed-9f4b580baae0" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a41a77-b27b-4316-990d-656e1e746ddf]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:28 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 Jul 15 18:48:28 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:28 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906" returned: 0 in 0.484s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:28 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906 Jul 15 18:48:28 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:28 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 Jul 15 18:48:28 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:28 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:28 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a2c52a3b-8ddb-446d-9103-5916ad9c5906" returned: 0 in 0.265s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219" returned: 0 in 0.450s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-quobyte-a2c52a3b-8ddb-446d-9103-5916ad9c5906" released by "delete_volume" :: held 0.831s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7090fc-243d-4f99-82d2-5fb103b4e9ff]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Created reservations ['91fbd0fd-df2f-4932-bffe-6b244a3d2405', 'b8c6c8c4-f97f-4256-be94-ecb7aa03a9a0', 'af7da571-cbc8-4166-a747-a3cf8056fa25', 'b7563fb4-a1ac-4379-b5c2-791d6693dbd6'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:28 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0" returned: 0 in 0.468s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:28 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 Jul 15 18:48:28 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:28 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0 Jul 15 18:48:28 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:28 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:28 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:28 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.327s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:28 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:28 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Deleted volume successfully. Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-acacfc48-f9d4-496f-b3c7-808fab8dc0c4 tempest-CreateVolumesFromSourceVolumeTest-1770927281 None] Lock "cinder-a2c52a3b-8ddb-446d-9103-5916ad9c5906-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:29 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-851e7835-4e9e-46bd-a0ed-9f4b580baae0" returned: 0 in 0.519s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:29 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-851e7835-4e9e-46bd-a0ed-9f4b580baae0" released by "delete_volume" :: held 1.054s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79" returned: 0 in 0.651s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:29 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 Jul 15 18:48:29 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Created reservations ['494c6960-4d56-44cd-8d44-006e6b7c6d4e', '0edb7206-4511-4081-8b5b-5fa33078382b', 'ff8a525b-49f1-4376-a76d-da09164ee405', '92ab9e0d-1796-4cd5-97ab-98785e76eb05'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:29 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:29 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:29 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:29 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.303s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219" returned: 0 in 0.489s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:29 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Deleted volume successfully. Jul 15 18:48:29 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219 Jul 15 18:48:29 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a0da1d0f-97b0-44d8-9d18-aeb7e9a724d6 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-851e7835-4e9e-46bd-a0ed-9f4b580baae0-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:29 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79.5d8466c1-f398-4aa0-8fec-a22531cac219" returned: 0 in 0.335s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-5d8466c1-f398-4aa0-8fec-a22531cac219" released by "_delete_snapshot" :: held 2.077s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:29 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-0f7d145a-a396-4aef-bb58-1f388e2c8e79" released by "delete_snapshot" :: held 2.115s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Created reservations ['e0503890-13c7-43bf-b58e-f23418ccf8d8', 'f8452c6b-e246-4b0f-879c-d13d00bef207', '22cce4fa-2160-4c64-a272-15cc62abea8e', 'c8d80d77-a135-461c-a562-33f809603bc1'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:30 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Delete snapshot completed successfully. Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2045066e-a1b8-4c15-9dde-eba4c90f8e10 tempest-ProjectMemberTests-529349186 None] Lock "cinder-5d8466c1-f398-4aa0-8fec-a22531cac219-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Flow 'volume_create_manager' (1b63ceb6-89ae-407b-8795-c486da7887b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7ed67a-ef1c-4b60-a501-d000b828178b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7ed67a-ef1c-4b60-a501-d000b828178b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1748761056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79ff06d-15cf-42b3-93ed-709520dbda95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65819e7e0434e75b5763d766ec01872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:31Z,use_quota=True,user_id='a721f65ba8e44bf1ba2f0f8c39805f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5820b2b4-e8d4-4be6-abf2-1922997b5fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5820b2b4-e8d4-4be6-abf2-1922997b5fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03679db4-cd8c-4263-936e-0ba13662b940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03679db4-cd8c-4263-936e-0ba13662b940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b79ff06d-15cf-42b3-93ed-709520dbda95', 'volume_name': 'volume-b79ff06d-15cf-42b3-93ed-709520dbda95', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06dcb986-b5b4-498e-93f8-7a23f0475950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06dcb986-b5b4-498e-93f8-7a23f0475950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11819662-d705-4d92-9e1b-1dd29d0e91ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:30 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Volume b79ff06d-15cf-42b3-93ed-709520dbda95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b79ff06d-15cf-42b3-93ed-709520dbda95', 'volume_size': 1} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1748761056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79ff06d-15cf-42b3-93ed-709520dbda95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65819e7e0434e75b5763d766ec01872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:31Z,use_quota=True,user_id='a721f65ba8e44bf1ba2f0f8c39805f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Creating volume b79ff06d-15cf-42b3-93ed-709520dbda95 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:30 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:30 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:30 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 1073741824 Jul 15 18:48:30 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-0f7d145a-a396-4aef-bb58-1f388e2c8e79-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Lock "cinder-0f7d145a-a396-4aef-bb58-1f388e2c8e79-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-0f7d145a-a396-4aef-bb58-1f388e2c8e79" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-0f7d145a-a396-4aef-bb58-1f388e2c8e79" acquired by "delete_volume" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f073a2-63e1-4b56-9d2b-f5c0bd0b0c08]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:31 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 1073741824" returned: 0 in 0.493s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:31 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 Jul 15 18:48:31 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:31 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 Jul 15 18:48:31 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:31 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95" returned: 0 in 0.284s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11819662-d705-4d92-9e1b-1dd29d0e91ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b79ff06d-15cf-42b3-93ed-709520dbda95', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43329fe7-49df-4bf3-b587-ffc0206845d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:31 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Volume volume-b79ff06d-15cf-42b3-93ed-709520dbda95 (b79ff06d-15cf-42b3-93ed-709520dbda95): created successfully Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43329fe7-49df-4bf3-b587-ffc0206845d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Flow 'volume_create_manager' (1b63ceb6-89ae-407b-8795-c486da7887b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:31 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-3c4b34d3-026b-46f2-9e93-5d796dc12184 tempest-ProjectReaderTests-1365279000 None] Created volume successfully. Jul 15 18:48:31 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79" returned: 0 in 0.414s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:31 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79 Jul 15 18:48:31 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:31 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-0f7d145a-a396-4aef-bb58-1f388e2c8e79" returned: 0 in 0.281s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-0f7d145a-a396-4aef-bb58-1f388e2c8e79" released by "delete_volume" :: held 0.770s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:31 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Created reservations ['12d719de-28de-48b0-9011-7328f3d00950', '60c8d3ca-170e-4fee-975c-726c38373c0b', 'b53ea76e-acb2-45da-b25f-fe5b3f3ebecd', '9dec71a8-1fbc-4309-9b8a-4c9e7de44677'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:32 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:32 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:32 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.254s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:32 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Deleted volume successfully. Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-62c5f270-e543-43e7-a896-e7165e94fb80 tempest-ProjectMemberTests-529349186 None] Lock "cinder-0f7d145a-a396-4aef-bb58-1f388e2c8e79-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:32 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:32 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (914b4295-3078-438d-b6cb-813d41373f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230462c2-d8ae-4c80-9cb7-a78daae86918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230462c2-d8ae-4c80-9cb7-a78daae86918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1837798772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:33Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46118782-0efe-4f3f-883d-a02585359a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46118782-0efe-4f3f-883d-a02585359a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff977e09-625c-4645-8c28-462f6ec640c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff977e09-625c-4645-8c28-462f6ec640c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce', 'volume_name': 'volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915bfb44-b025-4f6c-8c6c-a43c5a1042b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915bfb44-b025-4f6c-8c6c-a43c5a1042b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09176b9-d606-4301-8805-92250aeb8615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:32 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Volume e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce', 'volume_size': 1} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1837798772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:33Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Creating volume e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:32 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:32 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce 1073741824 Jul 15 18:48:32 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:33 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.335s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:48:33 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce 1073741824" returned: 0 in 0.492s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:33 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce Jul 15 18:48:33 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:33 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce" returned: 0 in 0.264s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.679s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09176b9-d606-4301-8805-92250aeb8615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d5d735-9f9c-4f47-bde4-e5e5226c64c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] Creating offline snapshot 729526e8-1183-487d-881e-3826f14ccebd of volume b79ff06d-15cf-42b3-93ed-709520dbda95 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:33 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Volume volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce (e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce): created successfully Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d5d735-9f9c-4f47-bde4-e5e5226c64c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (914b4295-3078-438d-b6cb-813d41373f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[863c882b-073f-42f4-907a-10fdf59869ef]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:33 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:33 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-625f2db7-7f71-4b82-ad58-9448685be276 tempest-ProjectMemberTests-529349186 None] Created volume successfully. Jul 15 18:48:33 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 Jul 15 18:48:33 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:34 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95" returned: 0 in 0.378s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:34 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd 1G Jul 15 18:48:34 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Flow 'volume_create_manager' (6ee0efcc-707c-410d-8994-69e3c588099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:34 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d9ab05-ab5d-4085-aac6-4417bd234a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd 1G" returned: 0 in 0.462s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b79ff06d-15cf-42b3-93ed-709520dbda95 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d9ab05-ab5d-4085-aac6-4417bd234a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a15cde6-66dc-4b6a-a25c-4d4a6765c122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4f538ee29e414a8e338267818a10ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:35Z,use_quota=True,user_id='ea09827e313943fea5396acd9f40ae8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:34 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b79ff06d-15cf-42b3-93ed-709520dbda95 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd Jul 15 18:48:34 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f31a90-721d-4073-ab14-afee2109590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f31a90-721d-4073-ab14-afee2109590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ae70d6-3a62-41bd-a00b-1d1e2ced08fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.image.glance [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Creating Keystone auth plugin from conf {{(pid=87217) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ae70d6-3a62-41bd-a00b-1d1e2ced08fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a15cde6-66dc-4b6a-a25c-4d4a6765c122', 'volume_name': 'volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122', 'volume_size': 1, 'image_id': '8cdeffce-006e-465f-a5e6-90a117b52dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8cdeffce-006e-465f-a5e6-90a117b52dbb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07422812dc289860ea083b710062dca5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec4f538ee29e414a8e338267818a10ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5351188ff66a68586e530342c3b48a5a0b112758b7565fd3b292e8f586515b73a4fe4d97c29e995c3b3e8def269d4579b1082d494ea28c400be2ca6958dee2a', 'id': '8cdeffce-006e-465f-a5e6-90a117b52dbb', 'created_at': datetime.datetime(2026, 7, 15, 16, 48, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 48, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8cdeffce-006e-465f-a5e6-90a117b52dbb/file', 'properties': {}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118e1f95-653e-4801-ae52-b568df7ba569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118e1f95-653e-4801-ae52-b568df7ba569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b550e6d-ced0-43ff-abda-fdd3ddef6388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:34 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Volume 4a15cde6-66dc-4b6a-a25c-4d4a6765c122: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122', 'volume_size': 1, 'image_id': '8cdeffce-006e-465f-a5e6-90a117b52dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8cdeffce-006e-465f-a5e6-90a117b52dbb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07422812dc289860ea083b710062dca5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec4f538ee29e414a8e338267818a10ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5351188ff66a68586e530342c3b48a5a0b112758b7565fd3b292e8f586515b73a4fe4d97c29e995c3b3e8def269d4579b1082d494ea28c400be2ca6958dee2a', 'id': '8cdeffce-006e-465f-a5e6-90a117b52dbb', 'created_at': datetime.datetime(2026, 7, 15, 16, 48, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 48, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8cdeffce-006e-465f-a5e6-90a117b52dbb/file', 'properties': {}}, 'image_service': } Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Trying to clone 4a15cde6-66dc-4b6a-a25c-4d4a6765c122 from image 8cdeffce-006e-465f-a5e6-90a117b52dbb at location (None, [{'url': 'file:///opt/stack/data/glance/images/8cdeffce-006e-465f-a5e6-90a117b52dbb', 'metadata': {}}]). {{(pid=87217) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 15 18:48:34 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b79ff06d-15cf-42b3-93ed-709520dbda95 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd" returned: 0 in 0.339s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:34 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd is being set with open permissions: ugo+rw Jul 15 18:48:34 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:34 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd Jul 15 18:48:34 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 15 18:48:35 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Image download 0.00 MB at 0.00 MB/s Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d07ef6e-057d-4ea2-b799-7ab70f244dac]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:35 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD Jul 15 18:48:35 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:35 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd" returned: 0 in 0.314s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:35 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.info Jul 15 18:48:35 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:35 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:35 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.info" returned: 0 in 0.269s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:35 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.info is being set with open permissions: ugo+rw Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:35 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.info Jul 15 18:48:35 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:35 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD Jul 15 18:48:35 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:35 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.info" returned: 0 in 0.241s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:35 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.656s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Temporary image 8cdeffce-006e-465f-a5e6-90a117b52dbb is fetched for user ea09827e313943fea5396acd9f40ae8e. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] Creating offline snapshot a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d of volume e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:35 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-36c0d4ce-b7ed-414e-ab6d-3c980a509cfb tempest-ProjectReaderTests-1365279000 None] Create snapshot completed successfully Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d685650d-653a-471c-bac9-d518e722c5e6]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6e2fda-f5f7-40f0-8878-7ad817710ef2]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:35 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:35 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce Jul 15 18:48:35 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:36 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD Jul 15 18:48:36 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-729526e8-1183-487d-881e-3826f14ccebd-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Lock "cinder-729526e8-1183-487d-881e-3826f14ccebd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-b79ff06d-15cf-42b3-93ed-709520dbda95" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-b79ff06d-15cf-42b3-93ed-709520dbda95" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-729526e8-1183-487d-881e-3826f14ccebd" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-729526e8-1183-487d-881e-3826f14ccebd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Deleting offline snapshot 729526e8-1183-487d-881e-3826f14ccebd of volume b79ff06d-15cf-42b3-93ed-709520dbda95 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:36 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] snapshot_file for this snap is: volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[306242ee-ede0-4d68-a914-6185d02ddf89]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:36 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce" returned: 0 in 0.424s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:36 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d 1G Jul 15 18:48:36 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:36 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD Jul 15 18:48:36 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:36 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd Jul 15 18:48:36 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:36 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:36 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd" returned: 0 in 0.363s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b79ff06d-15cf-42b3-93ed-709520dbda95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c766ec6-ceb3-4b4c-b128-a677f59d5ef7]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:36 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d 1G" returned: 0 in 0.444s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:36 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:36 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d Jul 15 18:48:36 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:36 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 Jul 15 18:48:36 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:37 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d" returned: 0 in 0.289s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:37 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d is being set with open permissions: ugo+rw Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:37 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95" returned: 0 in 0.370s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:37 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d Jul 15 18:48:37 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:37 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd Jul 15 18:48:37 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:37 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d" returned: 0 in 0.239s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:37 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.info Jul 15 18:48:37 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:37 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd" returned: 0 in 0.357s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:37 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd Jul 15 18:48:37 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:37 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.info" returned: 0 in 0.258s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:37 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.info is being set with open permissions: ugo+rw Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:37 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.info Jul 15 18:48:37 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:37 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95.729526e8-1183-487d-881e-3826f14ccebd" returned: 0 in 0.264s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-729526e8-1183-487d-881e-3826f14ccebd" released by "_delete_snapshot" :: held 1.454s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-b79ff06d-15cf-42b3-93ed-709520dbda95" released by "delete_snapshot" :: held 1.477s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Created reservations ['f1827ead-48ce-465b-a5f1-2a11b9901749', '49cca69b-918b-423b-8a25-32c63717326a', 'b0c79f5e-f05f-47e2-8fa7-2769ddd59af7', '9c9a320d-e6e4-43ad-a40b-49d4e9c0d33b'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:37 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.info" returned: 0 in 0.240s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.992s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.181s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a15cde6-66dc-4b6a-a25c-4d4a6765c122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4f538ee29e414a8e338267818a10ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:35Z,use_quota=True,user_id='ea09827e313943fea5396acd9f40ae8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Creating volume 4a15cde6-66dc-4b6a-a25c-4d4a6765c122 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:37 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:37 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 1073741824 Jul 15 18:48:37 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f455a7ab-f3fa-4e11-92dc-dab559929868 tempest-ProjectMemberTests-529349186 None] Create snapshot completed successfully Jul 15 18:48:37 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Delete snapshot completed successfully. Jul 15 18:48:37 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9fd68b33-741d-475b-a763-94573cd0318a tempest-ProjectReaderTests-1365279000 None] Lock "cinder-729526e8-1183-487d-881e-3826f14ccebd-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:38 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 1073741824" returned: 0 in 0.423s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Lock "cinder-a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:38 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 Jul 15 18:48:38 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Deleting offline snapshot a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d of volume e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] snapshot_file for this snap is: volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-b79ff06d-15cf-42b3-93ed-709520dbda95-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[93361c0a-1ed5-4229-8583-346447b4fbfa]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-b79ff06d-15cf-42b3-93ed-709520dbda95-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-b79ff06d-15cf-42b3-93ed-709520dbda95" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-b79ff06d-15cf-42b3-93ed-709520dbda95" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[1481d400-af35-4364-810e-f8e5f21913aa]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:38 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d Jul 15 18:48:38 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:38 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122" returned: 0 in 0.333s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Attempting download of 8cdeffce-006e-465f-a5e6-90a117b52dbb ((None, [{'url': 'file:///opt/stack/data/glance/images/8cdeffce-006e-465f-a5e6-90a117b52dbb', 'metadata': {}}])) to volume 4a15cde6-66dc-4b6a-a25c-4d4a6765c122. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 15 18:48:38 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 Jul 15 18:48:38 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04b7b22-8798-453a-89b4-502c7ee42d85]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8cdeffce-006e-465f-a5e6-90a117b52dbb_igej4m4f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:38 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8cdeffce-006e-465f-a5e6-90a117b52dbb_igej4m4f Jul 15 18:48:38 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:38 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d" returned: 0 in 0.467s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff55a848-6d9a-480e-9adc-9a62f9c2af5d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:38 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95" returned: 0 in 0.418s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:38 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:39 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95 Jul 15 18:48:39 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:39 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce Jul 15 18:48:39 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:39 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8cdeffce-006e-465f-a5e6-90a117b52dbb_igej4m4f" returned: 0 in 0.359s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8cdeffce-006e-465f-a5e6-90a117b52dbb_igej4m4f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:39 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8cdeffce-006e-465f-a5e6-90a117b52dbb_igej4m4f Jul 15 18:48:39 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:39 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-b79ff06d-15cf-42b3-93ed-709520dbda95" returned: 0 in 0.258s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-b79ff06d-15cf-42b3-93ed-709520dbda95" released by "delete_volume" :: held 0.744s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:39 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce" returned: 0 in 0.394s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Created reservations ['805e1d7f-b393-4c9b-ad35-225765ca230c', 'fa5caabd-5a0f-48f6-a88f-0f11f944385f', 'e47f5eb3-f62d-477e-a6a3-285b0e8882d7', 'a6cc56b4-b922-445f-b488-0c53f09ac6f0'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:39 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d Jul 15 18:48:39 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:39 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8cdeffce-006e-465f-a5e6-90a117b52dbb_igej4m4f" returned: 1 in 0.350s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8cdeffce-006e-465f-a5e6-90a117b52dbb_igej4m4f' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4851819-9dc5-4bd0-9389-b77eeb0172a6]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:39 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:39 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:39 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD Jul 15 18:48:39 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:39 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:39 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.268s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d" returned: 0 in 0.380s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:39 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Deleted volume successfully. Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-5d792765-0773-449b-987c-4d4fe4397173 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-b79ff06d-15cf-42b3-93ed-709520dbda95-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:39 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d Jul 15 18:48:39 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:39 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:39 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:39 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD Jul 15 18:48:39 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:40 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce.a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d" returned: 0 in 0.318s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d" released by "_delete_snapshot" :: held 1.715s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce" released by "delete_snapshot" :: held 1.752s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Flow 'volume_create_manager' (9d49db9c-26d5-4823-a9c9-37930f7cce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe44146-4156-4ccd-9013-e5400af06e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe44146-4156-4ccd-9013-e5400af06e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487178640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47a9958-d1cf-42a0-8d9e-03c6d0098a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65819e7e0434e75b5763d766ec01872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:40Z,use_quota=True,user_id='a721f65ba8e44bf1ba2f0f8c39805f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd7c765-8af5-437c-8b30-ccb8db8fdc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd7c765-8af5-437c-8b30-ccb8db8fdc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd93f824-513b-4fee-af65-e11959852d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd93f824-513b-4fee-af65-e11959852d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f47a9958-d1cf-42a0-8d9e-03c6d0098a00', 'volume_name': 'volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0791c32b-8940-474e-be70-db5fe7ff065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0791c32b-8940-474e-be70-db5fe7ff065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0199d8-ff4d-4e80-b215-b2269f827adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:40 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Volume f47a9958-d1cf-42a0-8d9e-03c6d0098a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00', 'volume_size': 1} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487178640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47a9958-d1cf-42a0-8d9e-03c6d0098a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65819e7e0434e75b5763d766ec01872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:40Z,use_quota=True,user_id='a721f65ba8e44bf1ba2f0f8c39805f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Creating volume f47a9958-d1cf-42a0-8d9e-03c6d0098a00 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:40 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:40 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] 8cdeffce-006e-465f-a5e6-90a117b52dbb was raw, converting to raw {{(pid=87217) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 15 18:48:40 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 1073741824 Jul 15 18:48:40 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:40 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 Jul 15 18:48:40 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Created reservations ['74aad30a-594c-4387-9b49-7bd65845f086', 'b2e7bd81-a1e6-4f69-8f5b-67f2fb0ec6a5', '0c5b439c-2cb2-4425-8a73-cd6a0b635998', '526978a1-a017-4603-9bf4-b1f629e57453'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:40 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Delete snapshot completed successfully. Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-44cdaea1-ed22-44c3-a85d-09fe67d7d378 tempest-ProjectMemberTests-529349186 None] Lock "cinder-a58bf1a0-67a7-4eb5-a86d-c33c3852eb6d-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Lock "cinder-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce" acquired by "delete_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb86378-bd67-4f00-b4da-010dcc9edd26]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:40 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122" returned: 0 in 0.397s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8cdeffce-006e-465f-a5e6-90a117b52dbb_l0nt9wzrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:48:40 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Converted 0.00 MB image at 0.00 MB/s Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:40 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 1G Jul 15 18:48:40 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:40 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce Jul 15 18:48:40 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:40 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 1073741824" returned: 0 in 0.509s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:40 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 Jul 15 18:48:40 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:40 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 1G" returned: 0 in 0.325s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:40 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce" returned: 0 in 0.388s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9d75a8-7c88-47c9-8122-7e9a78951608]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:40 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:40 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce Jul 15 18:48:40 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:41 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00" returned: 0 in 0.278s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0199d8-ff4d-4e80-b215-b2269f827adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a03b493-dbf1-487c-be89-648d2b2c4fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:41 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Volume volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 (f47a9958-d1cf-42a0-8d9e-03c6d0098a00): created successfully Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a03b493-dbf1-487c-be89-648d2b2c4fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Flow 'volume_create_manager' (9d49db9c-26d5-4823-a9c9-37930f7cce04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:41 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b97311ef-c824-470a-aa93-8812a6872a27 tempest-ProjectReaderTests-1365279000 None] Created volume successfully. Jul 15 18:48:41 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 Jul 15 18:48:41 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:41 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce" returned: 0 in 0.286s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce" released by "delete_volume" :: held 0.738s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Created reservations ['764556f7-0dcf-4743-ad24-43ab75a51e1d', '880b3e26-c660-46f7-8042-53f4a9cf898c', '1ac6679d-63d9-4cb0-8fc6-5cc187dc59c5', 'e369f68a-da17-4464-970f-1e166273728e'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:41 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122" returned: 0 in 0.378s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:41 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:41 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:41 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 Jul 15 18:48:41 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:41 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.257s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:41 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Deleted volume successfully. Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b0af5065-5cb9-42cc-a3d4-47494db66063 tempest-ProjectMemberTests-529349186 None] Lock "cinder-e1bf9a3d-aec1-45d1-9cd4-625e8a23a1ce-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:41 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122" returned: 1 in 0.371s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Downloaded image 8cdeffce-006e-465f-a5e6-90a117b52dbb ((None, [{'url': 'file:///opt/stack/data/glance/images/8cdeffce-006e-465f-a5e6-90a117b52dbb', 'metadata': {}}])) to volume 4a15cde6-66dc-4b6a-a25c-4d4a6765c122 successfully. {{(pid=87217) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Temporary image 8cdeffce-006e-465f-a5e6-90a117b52dbb for user ea09827e313943fea5396acd9f40ae8e is deleted. {{(pid=87217) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.volume_utils [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Marking volume 4a15cde6-66dc-4b6a-a25c-4d4a6765c122 as bootable. {{(pid=87217) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Copying metadata from image 8cdeffce-006e-465f-a5e6-90a117b52dbb to 4a15cde6-66dc-4b6a-a25c-4d4a6765c122. {{(pid=87217) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Creating volume glance metadata for volume 4a15cde6-66dc-4b6a-a25c-4d4a6765c122 backed by image 8cdeffce-006e-465f-a5e6-90a117b52dbb with: {'image_id': '8cdeffce-006e-465f-a5e6-90a117b52dbb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '07422812dc289860ea083b710062dca5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87217) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b550e6d-ced0-43ff-abda-fdd3ddef6388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122', 'volume_size': 1, 'image_id': '8cdeffce-006e-465f-a5e6-90a117b52dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8cdeffce-006e-465f-a5e6-90a117b52dbb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07422812dc289860ea083b710062dca5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec4f538ee29e414a8e338267818a10ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5351188ff66a68586e530342c3b48a5a0b112758b7565fd3b292e8f586515b73a4fe4d97c29e995c3b3e8def269d4579b1082d494ea28c400be2ca6958dee2a', 'id': '8cdeffce-006e-465f-a5e6-90a117b52dbb', 'created_at': datetime.datetime(2026, 7, 15, 16, 48, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 15, 16, 48, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8cdeffce-006e-465f-a5e6-90a117b52dbb/file', 'properties': {}}, 'image_service': }' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b4fbb8-b8ec-47a9-970a-fa0ec6b8933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:41 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Volume volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 (4a15cde6-66dc-4b6a-a25c-4d4a6765c122): created successfully Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b4fbb8-b8ec-47a9-970a-fa0ec6b8933c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:41 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Flow 'volume_create_manager' (6ee0efcc-707c-410d-8994-69e3c588099d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:41 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-211925eb-5a7c-4f60-a68f-159cfe052d30 tempest-VolumeImageDependencyTests-399951867 None] Created volume successfully. Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Acquiring lock "cinder-4a15cde6-66dc-4b6a-a25c-4d4a6765c122-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Lock "cinder-4a15cde6-66dc-4b6a-a25c-4d4a6765c122-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (ee3b80f1-d584-4187-87a0-5ddb36999c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9af920-4c4b-44e1-a6e6-829bc9f8b9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9af920-4c4b-44e1-a6e6-829bc9f8b9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1472907809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd47c8e-4299-4b24-89cf-07fe7b0f746e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:42Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd1501d-8c33-4127-915f-0c5d8223111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd1501d-8c33-4127-915f-0c5d8223111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a1e78b-58bc-4dab-b0d4-ff9f2cc1fed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a1e78b-58bc-4dab-b0d4-ff9f2cc1fed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd47c8e-4299-4b24-89cf-07fe7b0f746e', 'volume_name': 'volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6da4062-27a5-45ea-a27e-a1cd8ebde152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6da4062-27a5-45ea-a27e-a1cd8ebde152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b29191-9dce-440a-b275-49b43f7a85ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:42 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Volume 4bd47c8e-4299-4b24-89cf-07fe7b0f746e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e', 'volume_size': 1} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1472907809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd47c8e-4299-4b24-89cf-07fe7b0f746e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:42Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Creating volume 4bd47c8e-4299-4b24-89cf-07fe7b0f746e {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:42 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Acquiring lock "cinder-quobyte-4a15cde6-66dc-4b6a-a25c-4d4a6765c122" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:42 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e 1073741824 Jul 15 18:48:42 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Lock "cinder-quobyte-4a15cde6-66dc-4b6a-a25c-4d4a6765c122" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf44b0e-e2a2-447d-b4c1-2e3c6d848f19]: (4, 'raw') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:42 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 Jul 15 18:48:42 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:42 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e 1073741824" returned: 0 in 0.444s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:42 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122" returned: 0 in 0.377s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:42 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e Jul 15 18:48:42 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:42 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 Jul 15 18:48:42 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:42 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e" returned: 0 in 0.268s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:42 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.634s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b29191-9dce-440a-b275-49b43f7a85ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5f2763-d007-4286-8ac9-852f039e25c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] Creating offline snapshot a28b2b10-af71-4980-adc8-7c1fa7a03499 of volume f47a9958-d1cf-42a0-8d9e-03c6d0098a00 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:43 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Volume volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e (4bd47c8e-4299-4b24-89cf-07fe7b0f746e): created successfully Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5f2763-d007-4286-8ac9-852f039e25c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (ee3b80f1-d584-4187-87a0-5ddb36999c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f186f7-2715-4a76-9250-79193d965af4]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:43 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9397edce-2739-4926-a539-175f18b88900 tempest-ProjectMemberTests-529349186 None] Created volume successfully. Jul 15 18:48:43 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122" returned: 1 in 0.384s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122' failed. Not Retrying. {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:43 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122 Jul 15 18:48:43 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:43 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 Jul 15 18:48:43 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:43 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4a15cde6-66dc-4b6a-a25c-4d4a6765c122" returned: 0 in 0.254s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Lock "cinder-quobyte-4a15cde6-66dc-4b6a-a25c-4d4a6765c122" released by "delete_volume" :: held 1.098s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Created reservations ['4201d8a8-3c11-4f78-bdfe-150ff7c7101a', 'a207c6cb-2051-44b7-97b0-2abb47afdfe9', '01d29312-0565-4a7e-a061-73982b76b32c', '74fe5912-3598-4e59-a64e-75d76615dc84'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:43 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00" returned: 0 in 0.385s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:43 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 1G Jul 15 18:48:43 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:43 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:43 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:43 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.257s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:43 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Deleted volume successfully. Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-6d377250-ec23-4ed0-ad6f-d0558c019f71 tempest-VolumeImageDependencyTests-399951867 None] Lock "cinder-4a15cde6-66dc-4b6a-a25c-4d4a6765c122-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:43 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 1G" returned: 0 in 0.410s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:43 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:43 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 Jul 15 18:48:43 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:44 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499" returned: 0 in 0.320s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:44 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 is being set with open permissions: ugo+rw Jul 15 18:48:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:44 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 Jul 15 18:48:44 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:44 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499" returned: 0 in 0.258s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:44 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.info Jul 15 18:48:44 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:44 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.info" returned: 0 in 0.252s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:44 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.info is being set with open permissions: ugo+rw Jul 15 18:48:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:44 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.info Jul 15 18:48:44 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:44 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:44 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.info" returned: 0 in 0.242s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.595s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] Creating offline snapshot 1cb5bd97-4658-4cfb-9e09-fd45a14efde8 of volume 4bd47c8e-4299-4b24-89cf-07fe7b0f746e {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:45 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a10894af-9099-439c-a7f3-959cc9a232d5 tempest-ProjectReaderTests-1365279000 None] Create snapshot completed successfully Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f303442-4c33-47d5-9827-fe3b9ef96541]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:45 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e Jul 15 18:48:45 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:45 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e" returned: 0 in 0.481s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:45 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 1G Jul 15 18:48:45 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-a28b2b10-af71-4980-adc8-7c1fa7a03499-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-a28b2b10-af71-4980-adc8-7c1fa7a03499-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-f47a9958-d1cf-42a0-8d9e-03c6d0098a00" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-f47a9958-d1cf-42a0-8d9e-03c6d0098a00" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-a28b2b10-af71-4980-adc8-7c1fa7a03499" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-a28b2b10-af71-4980-adc8-7c1fa7a03499" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Deleting offline snapshot a28b2b10-af71-4980-adc8-7c1fa7a03499 of volume f47a9958-d1cf-42a0-8d9e-03c6d0098a00 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] snapshot_file for this snap is: volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce99e5c-93fe-4f85-a261-cf75c7a61a35]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:45 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:45 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 Jul 15 18:48:45 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:46 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 1G" returned: 0 in 0.552s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:46 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 Jul 15 18:48:46 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:46 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499" returned: 0 in 0.453s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:46 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:46 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5a307d-5e14-4af6-abee-cd56a811c18d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:46 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 Jul 15 18:48:46 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:46 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8" returned: 0 in 0.341s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:46 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 is being set with open permissions: ugo+rw Jul 15 18:48:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:46 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 Jul 15 18:48:46 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:46 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00" returned: 0 in 0.441s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:46 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 Jul 15 18:48:46 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:46 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8" returned: 0 in 0.299s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:46 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:46 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.info Jul 15 18:48:46 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:47 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499" returned: 0 in 0.389s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:47 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.info" returned: 0 in 0.287s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:47 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.info is being set with open permissions: ugo+rw Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:47 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499 Jul 15 18:48:47 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:47 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.info Jul 15 18:48:47 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:47 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.info" returned: 0 in 0.263s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:47 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00.a28b2b10-af71-4980-adc8-7c1fa7a03499" returned: 0 in 0.301s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-a28b2b10-af71-4980-adc8-7c1fa7a03499" released by "_delete_snapshot" :: held 1.707s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-f47a9958-d1cf-42a0-8d9e-03c6d0098a00" released by "delete_snapshot" :: held 1.734s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:47 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9e13a3c3-5d3c-45fe-839b-4daa541bef15 tempest-ProjectMemberTests-529349186 None] Create snapshot completed successfully Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Created reservations ['848fa1c6-f678-4ec8-866e-e5190bf0744d', 'b2702025-2669-4127-ad6d-f78f66e639ea', '776e62ab-c17d-4e91-97fe-138568eabc5e', '8b0e6ea1-03ae-42fe-a6f8-50174bd2b877'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:47 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Delete snapshot completed successfully. Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-f8b613d6-42c9-4128-864f-bf831bec7011 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-a28b2b10-af71-4980-adc8-7c1fa7a03499-delete_snapshot" released by "delete_snapshot" :: held 1.913s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-1cb5bd97-4658-4cfb-9e09-fd45a14efde8-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Lock "cinder-1cb5bd97-4658-4cfb-9e09-fd45a14efde8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-4bd47c8e-4299-4b24-89cf-07fe7b0f746e" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-4bd47c8e-4299-4b24-89cf-07fe7b0f746e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-1cb5bd97-4658-4cfb-9e09-fd45a14efde8" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-1cb5bd97-4658-4cfb-9e09-fd45a14efde8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Deleting offline snapshot 1cb5bd97-4658-4cfb-9e09-fd45a14efde8 of volume 4bd47c8e-4299-4b24-89cf-07fe7b0f746e {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] snapshot_file for this snap is: volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[4343317f-284e-40b5-acda-d32b0cfdd516]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:47 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-f47a9958-d1cf-42a0-8d9e-03c6d0098a00-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:47 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Lock "cinder-f47a9958-d1cf-42a0-8d9e-03c6d0098a00-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-f47a9958-d1cf-42a0-8d9e-03c6d0098a00" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-f47a9958-d1cf-42a0-8d9e-03c6d0098a00" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3764d22d-6012-4eb0-a880-cceb2c20378b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:47 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:48 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 Jul 15 18:48:48 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:48 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8" returned: 0 in 0.455s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d409e43-c726-4b41-ba1b-018f82ed5dfe]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:48 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e Jul 15 18:48:48 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:48 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00" returned: 0 in 0.410s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:48 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00 Jul 15 18:48:48 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:48 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e" returned: 0 in 0.391s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:48 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 Jul 15 18:48:48 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:48 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-f47a9958-d1cf-42a0-8d9e-03c6d0098a00" returned: 0 in 0.312s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-f47a9958-d1cf-42a0-8d9e-03c6d0098a00" released by "delete_volume" :: held 0.798s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Created reservations ['ecd0135a-e598-4841-9dca-61763d30c40e', '8d7a9727-7565-4191-a2d9-634467de4dd1', '9ce56c24-2520-4f17-b0bf-95be787f6f8e', '7b916fe7-8f7c-4c8f-989c-3570c13f33d9'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:48 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:48 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:48 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:49 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8" returned: 0 in 0.483s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:49 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8 Jul 15 18:48:49 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:49 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.347s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:49 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Deleted volume successfully. Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c16a3cdd-1588-4182-a597-6ae84bbdc0dd tempest-ProjectReaderTests-1365279000 None] Lock "cinder-f47a9958-d1cf-42a0-8d9e-03c6d0098a00-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e.1cb5bd97-4658-4cfb-9e09-fd45a14efde8" returned: 0 in 0.299s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:49 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-1cb5bd97-4658-4cfb-9e09-fd45a14efde8" released by "_delete_snapshot" :: held 1.741s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-4bd47c8e-4299-4b24-89cf-07fe7b0f746e" released by "delete_snapshot" :: held 1.771s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Created reservations ['c714b40d-00c1-44ce-91f1-0aec740668b9', 'bb0742fc-b56f-4f1a-93e6-5bf6193f942a', '95b19007-af1b-4dab-854d-36d07e03dd14', 'ca88b263-f3f4-4172-9ebf-7d7f6953333d'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:49 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Delete snapshot completed successfully. Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-9b6cd130-2a4d-46bd-af3e-2995b698bc3b tempest-ProjectMemberTests-529349186 None] Lock "cinder-1cb5bd97-4658-4cfb-9e09-fd45a14efde8-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Flow 'volume_create_manager' (17eac299-e172-42c3-9815-c4bbd65022af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9d415b-8f8e-496a-a23d-28aa4d331c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9d415b-8f8e-496a-a23d-28aa4d331c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849087125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600e1d38-ae47-4947-a806-488ba29d1c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65819e7e0434e75b5763d766ec01872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:50Z,use_quota=True,user_id='a721f65ba8e44bf1ba2f0f8c39805f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8576344-8e85-4608-8500-60ca75fafbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8576344-8e85-4608-8500-60ca75fafbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58307d5-5231-49c8-9821-80bf8080f186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58307d5-5231-49c8-9821-80bf8080f186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600e1d38-ae47-4947-a806-488ba29d1c97', 'volume_name': 'volume-600e1d38-ae47-4947-a806-488ba29d1c97', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c9cc6d7-0490-4164-9ecb-721a38461c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c9cc6d7-0490-4164-9ecb-721a38461c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c492d56-87b8-4ecb-baa8-0a11a33ab19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:49 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Volume 600e1d38-ae47-4947-a806-488ba29d1c97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600e1d38-ae47-4947-a806-488ba29d1c97', 'volume_size': 1} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849087125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600e1d38-ae47-4947-a806-488ba29d1c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65819e7e0434e75b5763d766ec01872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:50Z,use_quota=True,user_id='a721f65ba8e44bf1ba2f0f8c39805f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Creating volume 600e1d38-ae47-4947-a806-488ba29d1c97 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:49 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:49 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 1073741824 Jul 15 18:48:49 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-4bd47c8e-4299-4b24-89cf-07fe7b0f746e-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Lock "cinder-4bd47c8e-4299-4b24-89cf-07fe7b0f746e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-4bd47c8e-4299-4b24-89cf-07fe7b0f746e" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-4bd47c8e-4299-4b24-89cf-07fe7b0f746e" acquired by "delete_volume" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d58ef0a-fc0b-4f9d-9417-ae0a2dd39c73]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:49 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:50 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e Jul 15 18:48:50 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:50 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 1073741824" returned: 0 in 0.557s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:50 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 Jul 15 18:48:50 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:50 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e" returned: 0 in 0.461s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:50 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e Jul 15 18:48:50 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:50 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97" returned: 0 in 0.304s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c492d56-87b8-4ecb-baa8-0a11a33ab19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600e1d38-ae47-4947-a806-488ba29d1c97', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6ca5a9-3eb5-43af-834d-5392fcaa734c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:50 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:50 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Volume volume-600e1d38-ae47-4947-a806-488ba29d1c97 (600e1d38-ae47-4947-a806-488ba29d1c97): created successfully Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6ca5a9-3eb5-43af-834d-5392fcaa734c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Flow 'volume_create_manager' (17eac299-e172-42c3-9815-c4bbd65022af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4bd47c8e-4299-4b24-89cf-07fe7b0f746e" returned: 0 in 0.314s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-4bd47c8e-4299-4b24-89cf-07fe7b0f746e" released by "delete_volume" :: held 0.859s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:50 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-bb40c38a-8710-43a2-8f58-72f19b1448c5 tempest-ProjectReaderTests-1365279000 None] Created volume successfully. Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Created reservations ['f60991af-5663-41e9-91b3-ec90b6b374b6', '23684dea-1819-400e-85c0-c1fb1b7b2b58', '6013b3f8-8a36-47e4-8338-08a0b013ff78', '1f46d22f-460e-4921-9bb4-b48032c079d8'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:50 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:50 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:50 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:51 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.281s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:51 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Deleted volume successfully. Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-b8d23904-5765-47c2-bf1e-65f9cd630e07 tempest-ProjectMemberTests-529349186 None] Lock "cinder-4bd47c8e-4299-4b24-89cf-07fe7b0f746e-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (17883714-df5d-46ca-a9ab-4e3d0f0aea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff847c5-6b1a-438b-af6a-2d1846c9e5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff847c5-6b1a-438b-af6a-2d1846c9e5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111832849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08111f76-19de-46ae-a540-2f979d54bdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:51Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c970e5c5-f732-40cc-b6c1-7b94638a9b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c970e5c5-f732-40cc-b6c1-7b94638a9b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2085bb9c-38b6-4627-8bb9-b40e05975748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2085bb9c-38b6-4627-8bb9-b40e05975748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08111f76-19de-46ae-a540-2f979d54bdc1', 'volume_name': 'volume-08111f76-19de-46ae-a540-2f979d54bdc1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cc4fe4-648f-4c72-aa2a-613ebcc30e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cc4fe4-648f-4c72-aa2a-613ebcc30e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec9936e-d1e2-4578-bf73-c16f47f9a25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:51 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Volume 08111f76-19de-46ae-a540-2f979d54bdc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08111f76-19de-46ae-a540-2f979d54bdc1', 'volume_size': 1} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111832849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08111f76-19de-46ae-a540-2f979d54bdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:51Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Creating volume 08111f76-19de-46ae-a540-2f979d54bdc1 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:51 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:51 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 1073741824 Jul 15 18:48:51 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:51 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:52 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 1073741824" returned: 0 in 0.511s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:52 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 Jul 15 18:48:52 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:52 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1" returned: 0 in 0.269s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.495s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec9936e-d1e2-4578-bf73-c16f47f9a25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08111f76-19de-46ae-a540-2f979d54bdc1', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505b2b59-a415-4bc8-9b3e-9287316e0e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] Creating offline snapshot adbf02b5-4863-40be-a158-8bc908e52b09 of volume 600e1d38-ae47-4947-a806-488ba29d1c97 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:52 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Volume volume-08111f76-19de-46ae-a540-2f979d54bdc1 (08111f76-19de-46ae-a540-2f979d54bdc1): created successfully Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505b2b59-a415-4bc8-9b3e-9287316e0e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (17883714-df5d-46ca-a9ab-4e3d0f0aea53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36c3276-8959-4e40-9bb6-ce717335c506]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:52 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d5e9452c-c37c-46eb-9fd9-d68848e6d0e8 tempest-ProjectMemberTests-529349186 None] Created volume successfully. Jul 15 18:48:52 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 Jul 15 18:48:52 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:52 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97" returned: 0 in 0.375s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:52 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:52 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 1G Jul 15 18:48:52 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:53 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 1G" returned: 0 in 0.445s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-600e1d38-ae47-4947-a806-488ba29d1c97 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:53 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-600e1d38-ae47-4947-a806-488ba29d1c97 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 Jul 15 18:48:53 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:53 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-600e1d38-ae47-4947-a806-488ba29d1c97 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09" returned: 0 in 0.331s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:53 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 is being set with open permissions: ugo+rw Jul 15 18:48:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:53 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 Jul 15 18:48:53 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:53 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09" returned: 0 in 0.257s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:53 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:54 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.info Jul 15 18:48:54 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:54 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.info" returned: 0 in 0.267s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:54 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.info is being set with open permissions: ugo+rw Jul 15 18:48:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:54 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.info Jul 15 18:48:54 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:54 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.info" returned: 0 in 0.251s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.698s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:54 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] Creating offline snapshot 76a686c5-db44-44f2-9aa9-583e5b9dead5 of volume 08111f76-19de-46ae-a540-2f979d54bdc1 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:48:54 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7dbc9a38-ca7d-4296-806c-d9422b0840f8 tempest-ProjectReaderTests-1365279000 None] Create snapshot completed successfully Jul 15 18:48:54 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b463c4-f3ca-447d-a2cf-2affac418ff3]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:54 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 Jul 15 18:48:54 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:54 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1" returned: 0 in 0.400s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:54 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:54 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 1G Jul 15 18:48:55 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-adbf02b5-4863-40be-a158-8bc908e52b09-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-adbf02b5-4863-40be-a158-8bc908e52b09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-600e1d38-ae47-4947-a806-488ba29d1c97" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-600e1d38-ae47-4947-a806-488ba29d1c97" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-adbf02b5-4863-40be-a158-8bc908e52b09" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-adbf02b5-4863-40be-a158-8bc908e52b09" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Deleting offline snapshot adbf02b5-4863-40be-a158-8bc908e52b09 of volume 600e1d38-ae47-4947-a806-488ba29d1c97 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] snapshot_file for this snap is: volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5b4ca8-c44a-4a25-93bd-9b8dfc9c4fb3]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:55 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 Jul 15 18:48:55 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:55 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 1G" returned: 0 in 0.499s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08111f76-19de-46ae-a540-2f979d54bdc1 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:55 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08111f76-19de-46ae-a540-2f979d54bdc1 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 Jul 15 18:48:55 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:55 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09" returned: 0 in 0.411s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-600e1d38-ae47-4947-a806-488ba29d1c97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f987211-fe45-4e7a-9f02-30fe545ce5bc]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:55 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08111f76-19de-46ae-a540-2f979d54bdc1 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5" returned: 0 in 0.325s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:55 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 is being set with open permissions: ugo+rw Jul 15 18:48:55 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:55 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 Jul 15 18:48:55 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:55 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 Jul 15 18:48:55 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:56 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5" returned: 0 in 0.312s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:56 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97" returned: 0 in 0.410s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:56 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 Jul 15 18:48:56 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:56 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.info Jul 15 18:48:56 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:56 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.info" returned: 0 in 0.264s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:56 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.info is being set with open permissions: ugo+rw Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:56 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.info Jul 15 18:48:56 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:56 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09" returned: 0 in 0.403s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:56 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09 Jul 15 18:48:56 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:56 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.info" returned: 0 in 0.284s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:56 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c7e46f10-0229-48aa-926b-73467453781e tempest-ProjectMemberTests-529349186 None] Create snapshot completed successfully Jul 15 18:48:56 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97.adbf02b5-4863-40be-a158-8bc908e52b09" returned: 0 in 0.268s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-adbf02b5-4863-40be-a158-8bc908e52b09" released by "_delete_snapshot" :: held 1.611s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-600e1d38-ae47-4947-a806-488ba29d1c97" released by "delete_snapshot" :: held 1.637s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Created reservations ['b1135e6c-637b-4c57-8768-36717328e5f2', 'e653738d-26ac-48d4-ae36-66bbc78e06fe', '5eb4f144-0da2-4247-8cd6-3a7e0b18af8c', 'd5505f0b-19c7-409a-b95b-19fcdc19fe4c'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:56 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Delete snapshot completed successfully. Jul 15 18:48:56 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-86b9a737-bb80-406d-8e78-ad28e4790c27 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-adbf02b5-4863-40be-a158-8bc908e52b09-delete_snapshot" released by "delete_snapshot" :: held 1.803s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-76a686c5-db44-44f2-9aa9-583e5b9dead5-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Lock "cinder-76a686c5-db44-44f2-9aa9-583e5b9dead5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-08111f76-19de-46ae-a540-2f979d54bdc1" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-08111f76-19de-46ae-a540-2f979d54bdc1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-76a686c5-db44-44f2-9aa9-583e5b9dead5" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-76a686c5-db44-44f2-9aa9-583e5b9dead5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Deleting offline snapshot 76a686c5-db44-44f2-9aa9-583e5b9dead5 of volume 08111f76-19de-46ae-a540-2f979d54bdc1 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] snapshot_file for this snap is: volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb171b6-7777-4080-b55f-4145b4dbda82]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:57 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 Jul 15 18:48:57 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-600e1d38-ae47-4947-a806-488ba29d1c97-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-600e1d38-ae47-4947-a806-488ba29d1c97-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-600e1d38-ae47-4947-a806-488ba29d1c97" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-600e1d38-ae47-4947-a806-488ba29d1c97" acquired by "delete_volume" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[14196058-8bdb-4e27-8227-57254b954511]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:57 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5" returned: 0 in 0.407s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08111f76-19de-46ae-a540-2f979d54bdc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[772812f5-99f5-482b-bb32-1efbc1e63252]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:57 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 Jul 15 18:48:57 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:57 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 Jul 15 18:48:57 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:57 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97" returned: 0 in 0.396s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:57 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97 Jul 15 18:48:57 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:57 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1" returned: 0 in 0.362s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:57 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:57 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 Jul 15 18:48:57 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:58 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-600e1d38-ae47-4947-a806-488ba29d1c97" returned: 0 in 0.285s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-600e1d38-ae47-4947-a806-488ba29d1c97" released by "delete_volume" :: held 0.743s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Created reservations ['086452be-b7a1-4a9a-9005-35e51898fda6', 'd6916565-3f3f-4383-9449-e6388129e394', '597f05fa-1831-4cf5-97a2-64967cf006a0', '0d4536cc-af17-41c6-a769-61e7b4335e4a'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:58 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5" returned: 0 in 0.358s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:58 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5 Jul 15 18:48:58 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:58 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:48:58 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:58 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1.76a686c5-db44-44f2-9aa9-583e5b9dead5" returned: 0 in 0.307s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:58 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.297s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-76a686c5-db44-44f2-9aa9-583e5b9dead5" released by "_delete_snapshot" :: held 1.565s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Deleted volume successfully. Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-08111f76-19de-46ae-a540-2f979d54bdc1" released by "delete_snapshot" :: held 1.594s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7fbb5acd-5a2b-4520-97c6-894169017479 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-600e1d38-ae47-4947-a806-488ba29d1c97-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Created reservations ['03c87fc6-4de1-49cf-8ff5-817a096d0fb8', '556c6746-33f4-41c4-898d-7d2bf55a7342', 'a337114c-67f5-400b-8e89-f5e07bdd46b9', 'db1eef19-6428-4cd6-967e-a0fb63ffeb14'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:48:58 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Delete snapshot completed successfully. Jul 15 18:48:58 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-582c5a08-0dc5-49b8-8a89-41b20c2b1bab tempest-ProjectMemberTests-529349186 None] Lock "cinder-76a686c5-db44-44f2-9aa9-583e5b9dead5-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Flow 'volume_create_manager' (aba3662f-b64c-49f3-843d-570b18304b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3c8317-aa2f-4715-af09-3c6aa289acab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3c8317-aa2f-4715-af09-3c6aa289acab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2140173142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85824cc5-b868-45a1-b90c-b3a0dd0bef23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65819e7e0434e75b5763d766ec01872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:59Z,use_quota=True,user_id='a721f65ba8e44bf1ba2f0f8c39805f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f11b97c-b634-47c2-93af-ecc15d376fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f11b97c-b634-47c2-93af-ecc15d376fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cee2f9a-240a-49c7-975f-03535a5d782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cee2f9a-240a-49c7-975f-03535a5d782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85824cc5-b868-45a1-b90c-b3a0dd0bef23', 'volume_name': 'volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7597b66c-e782-45fe-9072-c5832e64ece1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7597b66c-e782-45fe-9072-c5832e64ece1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19b0508-ab20-42aa-9091-d83a3c98d132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:48:59 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Volume 85824cc5-b868-45a1-b90c-b3a0dd0bef23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23', 'volume_size': 1} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2140173142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85824cc5-b868-45a1-b90c-b3a0dd0bef23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65819e7e0434e75b5763d766ec01872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:48:59Z,use_quota=True,user_id='a721f65ba8e44bf1ba2f0f8c39805f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Creating volume 85824cc5-b868-45a1-b90c-b3a0dd0bef23 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:48:59 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-08111f76-19de-46ae-a540-2f979d54bdc1-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:59 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 1073741824 Jul 15 18:48:59 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Lock "cinder-08111f76-19de-46ae-a540-2f979d54bdc1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-08111f76-19de-46ae-a540-2f979d54bdc1" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-08111f76-19de-46ae-a540-2f979d54bdc1" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[027d48fe-ff29-4d35-9e05-963f2aea9334]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:59 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 Jul 15 18:48:59 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:59 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 1073741824" returned: 0 in 0.451s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:59 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 Jul 15 18:48:59 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:59 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1" returned: 0 in 0.424s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:48:59 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1 Jul 15 18:48:59 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:48:59 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23" returned: 0 in 0.260s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19b0508-ab20-42aa-9091-d83a3c98d132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:48:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb5d916-6778-498b-93c8-60ff2fddc80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:00 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Volume volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 (85824cc5-b868-45a1-b90c-b3a0dd0bef23): created successfully Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb5d916-6778-498b-93c8-60ff2fddc80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Flow 'volume_create_manager' (aba3662f-b64c-49f3-843d-570b18304b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:00 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-19ab56ce-6324-4a58-9675-dfab516128a0 tempest-ProjectReaderTests-1365279000 None] Created volume successfully. Jul 15 18:49:00 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-08111f76-19de-46ae-a540-2f979d54bdc1" returned: 0 in 0.272s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-08111f76-19de-46ae-a540-2f979d54bdc1" released by "delete_volume" :: held 0.763s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Created reservations ['5b3a443f-a8c3-49d4-940c-ca62b7ef64b3', '1ceebb80-c3c7-4d6b-b8a7-c6ee238b1053', '45336e59-877f-4295-8321-08396bdd2633', 'ea228b4c-8bd5-443b-81f1-331b31327811'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:00 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:49:00 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:00 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.272s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:00 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Deleted volume successfully. Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-70561fa6-9add-4b79-9550-e3499d94232a tempest-ProjectMemberTests-529349186 None] Lock "cinder-08111f76-19de-46ae-a540-2f979d54bdc1-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (a1454e90-3d9d-4695-b0a6-3d387d6d4f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5095f55-b53c-4b6e-9af5-231613192dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5095f55-b53c-4b6e-9af5-231613192dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-894922218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a9e9d0-21f4-4c81-9b66-8b3716d49cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:01Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a251e22-ec47-4adb-846e-43a08ccc67ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a251e22-ec47-4adb-846e-43a08ccc67ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3a362d-d047-4879-a3dc-b31541623b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3a362d-d047-4879-a3dc-b31541623b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a9e9d0-21f4-4c81-9b66-8b3716d49cdf', 'volume_name': 'volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d34ce92-4836-4873-bbaa-89b3bd762703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d34ce92-4836-4873-bbaa-89b3bd762703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3b4d2b-6140-4c89-b338-4c24f91c020f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:00 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Volume 55a9e9d0-21f4-4c81-9b66-8b3716d49cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf', 'volume_size': 1} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-894922218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a9e9d0-21f4-4c81-9b66-8b3716d49cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:01Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Creating volume 55a9e9d0-21f4-4c81-9b66-8b3716d49cdf {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:00 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:49:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:01 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf 1073741824 Jul 15 18:49:01 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:01 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf 1073741824" returned: 0 in 0.486s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:01 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf Jul 15 18:49:01 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:01 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf" returned: 0 in 0.239s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.369s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] Creating offline snapshot 90c9320b-1c76-4146-9162-edcc1cb1b1ff of volume 85824cc5-b868-45a1-b90c-b3a0dd0bef23 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3b4d2b-6140-4c89-b338-4c24f91c020f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69119f61-1a03-4b02-9d6a-dcdacbeed6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[00753e48-1274-4716-8307-ce222c6edb3f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:01 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Volume volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf (55a9e9d0-21f4-4c81-9b66-8b3716d49cdf): created successfully Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69119f61-1a03-4b02-9d6a-dcdacbeed6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:01 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (a1454e90-3d9d-4695-b0a6-3d387d6d4f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:01 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ef57f8bd-daeb-47a0-a605-f137cc5f086d tempest-ProjectMemberTests-529349186 None] Created volume successfully. Jul 15 18:49:01 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 Jul 15 18:49:01 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:02 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23" returned: 0 in 0.390s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:02 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff 1G Jul 15 18:49:02 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:02 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff 1G" returned: 0 in 0.417s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:02 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff Jul 15 18:49:02 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:02 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff" returned: 0 in 0.332s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:02 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff is being set with open permissions: ugo+rw Jul 15 18:49:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:02 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff Jul 15 18:49:02 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:03 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff" returned: 0 in 0.273s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:03 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.info Jul 15 18:49:03 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:03 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.info" returned: 0 in 0.278s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:03 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.info is being set with open permissions: ugo+rw Jul 15 18:49:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:03 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.info Jul 15 18:49:03 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:03 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.info" returned: 0 in 0.269s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.660s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] Creating offline snapshot 93cd760d-cf9b-4407-b6da-088f0b1b6507 of volume 55a9e9d0-21f4-4c81-9b66-8b3716d49cdf {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:49:03 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-b3f431c0-6d62-42c8-b16a-ad39f5e7c689 tempest-ProjectReaderTests-1365279000 None] Create snapshot completed successfully Jul 15 18:49:03 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be50c1f-11b2-4638-8822-c878fdbc68dd]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:03 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf Jul 15 18:49:03 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:04 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf" returned: 0 in 0.401s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:04 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 1G Jul 15 18:49:04 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-90c9320b-1c76-4146-9162-edcc1cb1b1ff-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-90c9320b-1c76-4146-9162-edcc1cb1b1ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-85824cc5-b868-45a1-b90c-b3a0dd0bef23" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-85824cc5-b868-45a1-b90c-b3a0dd0bef23" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-90c9320b-1c76-4146-9162-edcc1cb1b1ff" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-90c9320b-1c76-4146-9162-edcc1cb1b1ff" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Deleting offline snapshot 90c9320b-1c76-4146-9162-edcc1cb1b1ff of volume 85824cc5-b868-45a1-b90c-b3a0dd0bef23 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] snapshot_file for this snap is: volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[de066afa-346b-4c23-a2ae-5a6b47525664]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:04 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 1G" returned: 0 in 0.542s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:04 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff Jul 15 18:49:04 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:04 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 Jul 15 18:49:04 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:05 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff" returned: 0 in 0.434s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:05 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507" returned: 0 in 0.330s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:05 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 is being set with open permissions: ugo+rw Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38d602b-51c6-4a32-8d68-00f65b00f52e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:05 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 Jul 15 18:49:05 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:05 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 Jul 15 18:49:05 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:05 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507" returned: 0 in 0.282s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:05 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.info Jul 15 18:49:05 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:05 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23" returned: 0 in 0.413s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:05 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff Jul 15 18:49:05 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:05 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.info" returned: 0 in 0.296s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:05 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.info is being set with open permissions: ugo+rw Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:05 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.info Jul 15 18:49:05 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:05 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff" returned: 0 in 0.371s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:05 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:05 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff Jul 15 18:49:05 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:06 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.info" returned: 0 in 0.299s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:06 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-aba67c70-702f-4e4e-bca7-f51145d54557 tempest-ProjectMemberTests-529349186 None] Create snapshot completed successfully Jul 15 18:49:06 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23.90c9320b-1c76-4146-9162-edcc1cb1b1ff" returned: 0 in 0.299s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-90c9320b-1c76-4146-9162-edcc1cb1b1ff" released by "_delete_snapshot" :: held 1.623s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-85824cc5-b868-45a1-b90c-b3a0dd0bef23" released by "delete_snapshot" :: held 1.652s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Created reservations ['42066396-c4af-4683-846b-d768aa1b777a', 'e169be6d-c6d7-4f79-b659-863321823525', 'ffe103d7-597f-4520-8d10-d89608c8dc0c', '7a65decf-4f0b-469d-a717-7c54be333751'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-93cd760d-cf9b-4407-b6da-088f0b1b6507-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Lock "cinder-93cd760d-cf9b-4407-b6da-088f0b1b6507-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-93cd760d-cf9b-4407-b6da-088f0b1b6507" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-93cd760d-cf9b-4407-b6da-088f0b1b6507" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Deleting offline snapshot 93cd760d-cf9b-4407-b6da-088f0b1b6507 of volume 55a9e9d0-21f4-4c81-9b66-8b3716d49cdf {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] snapshot_file for this snap is: volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6741842b-7862-434e-9c99-c9f56282e0a9]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:06 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Delete snapshot completed successfully. Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-60c57877-f422-438b-89cc-08a4ed602088 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-90c9320b-1c76-4146-9162-edcc1cb1b1ff-delete_snapshot" released by "delete_snapshot" :: held 1.893s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:06 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 Jul 15 18:49:06 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-85824cc5-b868-45a1-b90c-b3a0dd0bef23-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-85824cc5-b868-45a1-b90c-b3a0dd0bef23-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "cinder-quobyte-85824cc5-b868-45a1-b90c-b3a0dd0bef23" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-85824cc5-b868-45a1-b90c-b3a0dd0bef23" acquired by "delete_volume" :: waited 0.021s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bedfc5-2714-41a8-b3a7-bf0270047a6a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:06 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507" returned: 0 in 0.411s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6482d787-b856-4d8a-b6b0-be9e7e96c7bf]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:06 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:06 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 Jul 15 18:49:06 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:07 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf Jul 15 18:49:07 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:07 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23" returned: 0 in 0.371s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:07 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23 Jul 15 18:49:07 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:07 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf" returned: 0 in 0.373s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:07 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 Jul 15 18:49:07 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:07 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-85824cc5-b868-45a1-b90c-b3a0dd0bef23" returned: 0 in 0.279s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-quobyte-85824cc5-b868-45a1-b90c-b3a0dd0bef23" released by "delete_volume" :: held 0.727s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Created reservations ['da7c44f1-0686-49f7-9cf1-e62c204df130', '435880eb-ba5f-4a5a-9e7f-b413b4a168c0', 'ae49f0e9-4fcc-4457-93a6-088db0987b83', '695a417f-6a8d-4ddb-a42e-7670f14fba2f'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:07 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507" returned: 0 in 0.413s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:07 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:49:07 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:07 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507 Jul 15 18:49:07 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:07 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.277s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:07 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Deleted volume successfully. Jul 15 18:49:07 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-bdc3b1f7-78ff-493d-9af6-807423127597 tempest-ProjectReaderTests-1365279000 None] Lock "cinder-85824cc5-b868-45a1-b90c-b3a0dd0bef23-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:08 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf.93cd760d-cf9b-4407-b6da-088f0b1b6507" returned: 0 in 0.322s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-93cd760d-cf9b-4407-b6da-088f0b1b6507" released by "_delete_snapshot" :: held 1.639s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf" released by "delete_snapshot" :: held 1.666s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:08 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Created reservations ['9d7f06c6-aeef-40a7-a6b9-8bb77bf74caa', 'db9b3669-b1c9-4fa3-a9a4-3f064831da90', '4ecc8efe-47e3-4ef6-98ac-0a2cf17e6b72', 'e99bbed0-64fa-4177-a045-b468dc409fd8'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:08 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Delete snapshot completed successfully. Jul 15 18:49:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-d2d867dc-b0b5-4bc0-a7f7-cf2c2598b3c4 tempest-ProjectMemberTests-529349186 None] Lock "cinder-93cd760d-cf9b-4407-b6da-088f0b1b6507-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Lock "cinder-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf" acquired by "delete_volume" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:08 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8a7db6-6561-4aa0-aa90-196e33432288]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:08 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf Jul 15 18:49:08 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:09 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf" returned: 0 in 0.406s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:09 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf Jul 15 18:49:09 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:09 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf" returned: 0 in 0.278s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf" released by "delete_volume" :: held 0.756s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Created reservations ['f3ce4f84-7209-4ff9-aaaf-7cdbc61b9023', 'fd6d70ce-7728-4948-a441-9a43f2058091', 'f2e7b999-8f3f-419c-9f1e-823d808d84d4', '016308c8-3a8f-4ece-8d0f-e4f82bd3b42c'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:09 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:49:09 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:09 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.394s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:09 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Deleted volume successfully. Jul 15 18:49:09 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7066538a-e0bd-4595-9a4d-937ed7691ce7 tempest-ProjectMemberTests-529349186 None] Lock "cinder-55a9e9d0-21f4-4c81-9b66-8b3716d49cdf-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (d8e46b67-76b9-4d0b-bcf9-1d902c72f08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151f79e3-692a-4328-a46c-0413debbe814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151f79e3-692a-4328-a46c-0413debbe814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143600387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51ddf4d-be28-4b7b-b1d0-7654f7923d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:10Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7908988-b2f0-4c43-9bf6-6908eeb5f3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7908988-b2f0-4c43-9bf6-6908eeb5f3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad03932-a957-4081-bd9e-7182a117e2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad03932-a957-4081-bd9e-7182a117e2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51ddf4d-be28-4b7b-b1d0-7654f7923d4b', 'volume_name': 'volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640055f0-d3d5-4162-a818-f84c70c48c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640055f0-d3d5-4162-a818-f84c70c48c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a05228-bec7-4cfa-b67c-143d24406030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:10 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Volume a51ddf4d-be28-4b7b-b1d0-7654f7923d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b', 'volume_size': 1} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143600387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51ddf4d-be28-4b7b-b1d0-7654f7923d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:10Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Creating volume a51ddf4d-be28-4b7b-b1d0-7654f7923d4b {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:10 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:10 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b 1073741824 Jul 15 18:49:10 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:10 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b 1073741824" returned: 0 in 0.507s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:11 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b Jul 15 18:49:11 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:11 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b" returned: 0 in 0.284s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a05228-bec7-4cfa-b67c-143d24406030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa723ac5-b37b-41d9-a4ae-662a5161d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:11 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Volume volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b (a51ddf4d-be28-4b7b-b1d0-7654f7923d4b): created successfully Jul 15 18:49:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa723ac5-b37b-41d9-a4ae-662a5161d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:11 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (d8e46b67-76b9-4d0b-bcf9-1d902c72f08b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:11 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1208eeea-da4b-4fe4-be38-52746f993a9a tempest-ProjectMemberTests-529349186 None] Created volume successfully. Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Flow 'volume_create_manager' (7dafced6-0ef5-4b0c-8cb6-15f595d52b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b643736-88c6-42e5-bcac-6604d3ebe9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b643736-88c6-42e5-bcac-6604d3ebe9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368155271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e922c50d-e141-4b29-af69-9fe4dd45f752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27f2a7360484eb08a7eb47679b96a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:12Z,use_quota=True,user_id='5175a693752f4986b025bfa994b6e6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef378b0-53e2-4ea6-b607-50dd05e159d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef378b0-53e2-4ea6-b607-50dd05e159d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e151bd-1b4b-4221-b357-b8a006012f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e151bd-1b4b-4221-b357-b8a006012f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e922c50d-e141-4b29-af69-9fe4dd45f752', 'volume_name': 'volume-e922c50d-e141-4b29-af69-9fe4dd45f752', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab7a827-01e3-459e-9c65-e67b91fb3802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab7a827-01e3-459e-9c65-e67b91fb3802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416edb1e-db60-42e1-9959-ab8af21d9582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:12 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Volume e922c50d-e141-4b29-af69-9fe4dd45f752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e922c50d-e141-4b29-af69-9fe4dd45f752', 'volume_size': 1} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368155271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e922c50d-e141-4b29-af69-9fe4dd45f752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27f2a7360484eb08a7eb47679b96a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:12Z,use_quota=True,user_id='5175a693752f4986b025bfa994b6e6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Creating volume e922c50d-e141-4b29-af69-9fe4dd45f752 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:12 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e922c50d-e141-4b29-af69-9fe4dd45f752 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:12 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e922c50d-e141-4b29-af69-9fe4dd45f752 1073741824 Jul 15 18:49:12 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:13 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e922c50d-e141-4b29-af69-9fe4dd45f752 1073741824" returned: 0 in 0.435s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e922c50d-e141-4b29-af69-9fe4dd45f752 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:13 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e922c50d-e141-4b29-af69-9fe4dd45f752 Jul 15 18:49:13 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:13 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e922c50d-e141-4b29-af69-9fe4dd45f752" returned: 0 in 0.241s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.680s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416edb1e-db60-42e1-9959-ab8af21d9582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e922c50d-e141-4b29-af69-9fe4dd45f752', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb976a5-307b-4443-b312-97ff6a5d514e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] Creating offline snapshot 52bb4bb3-68fa-4731-88fb-422f3f39ec9f of volume a51ddf4d-be28-4b7b-b1d0-7654f7923d4b {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:49:13 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Volume volume-e922c50d-e141-4b29-af69-9fe4dd45f752 (e922c50d-e141-4b29-af69-9fe4dd45f752): created successfully Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb976a5-307b-4443-b312-97ff6a5d514e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Flow 'volume_create_manager' (7dafced6-0ef5-4b0c-8cb6-15f595d52b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[095877e3-df6a-45bb-9911-df7aa9ec6216]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:13 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8f851b2b-8cc8-4543-8711-6a8522f116e8 tempest-ProjectReaderTests-1999097005 None] Created volume successfully. Jul 15 18:49:13 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b Jul 15 18:49:13 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Acquiring lock "cinder-e922c50d-e141-4b29-af69-9fe4dd45f752-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Lock "cinder-e922c50d-e141-4b29-af69-9fe4dd45f752-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Acquiring lock "cinder-quobyte-e922c50d-e141-4b29-af69-9fe4dd45f752" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Lock "cinder-quobyte-e922c50d-e141-4b29-af69-9fe4dd45f752" acquired by "delete_volume" :: waited 0.025s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:13 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b" returned: 0 in 0.414s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[55225ae0-94b1-4242-9ff9-b0cead6d049f]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e922c50d-e141-4b29-af69-9fe4dd45f752 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:13 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f 1G Jul 15 18:49:13 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:13 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e922c50d-e141-4b29-af69-9fe4dd45f752 Jul 15 18:49:13 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:14 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:14 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e922c50d-e141-4b29-af69-9fe4dd45f752" returned: 0 in 0.367s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e922c50d-e141-4b29-af69-9fe4dd45f752 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f 1G" returned: 0 in 0.392s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:14 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e922c50d-e141-4b29-af69-9fe4dd45f752 Jul 15 18:49:14 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:14 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f Jul 15 18:49:14 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:14 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-e922c50d-e141-4b29-af69-9fe4dd45f752" returned: 0 in 0.249s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Lock "cinder-quobyte-e922c50d-e141-4b29-af69-9fe4dd45f752" released by "delete_volume" :: held 0.670s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:14 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f" returned: 0 in 0.282s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:14 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f is being set with open permissions: ugo+rw Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:14 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f Jul 15 18:49:14 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Created reservations ['09b1c2e5-a718-489f-a7b5-0c779b3bb99b', '2b24bc14-d60f-4482-b963-7defcda6efd1', '48d49aa5-acda-47e2-b3ec-169b7d9eaec5', 'fe106479-a98e-48d4-89ba-5b568afcf9a7'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:14 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:49:14 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:14 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f" returned: 0 in 0.248s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:14 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.info Jul 15 18:49:14 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:14 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.267s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:14 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Deleted volume successfully. Jul 15 18:49:14 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a5d82e31-7b8b-4a5f-8540-8752e034de85 tempest-ProjectReaderTests-1999097005 None] Lock "cinder-e922c50d-e141-4b29-af69-9fe4dd45f752-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:15 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.info" returned: 0 in 0.274s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:15 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.info is being set with open permissions: ugo+rw Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:15 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.info Jul 15 18:49:15 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:15 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.info" returned: 0 in 0.244s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:15 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-70d72848-2c0d-4b68-bc59-e915643b37d5 tempest-ProjectMemberTests-529349186 None] Create snapshot completed successfully Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Flow 'volume_create_manager' (13c9655b-55a3-4d4f-8a2e-8cbe944a54a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7e1c9e-92d5-409d-813d-55343ff32c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7e1c9e-92d5-409d-813d-55343ff32c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1574686623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf9743b-5a00-4801-aad1-728e80aaf095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27f2a7360484eb08a7eb47679b96a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:15Z,use_quota=True,user_id='5175a693752f4986b025bfa994b6e6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c57ced-8888-4a40-ba3b-b7217641c654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c57ced-8888-4a40-ba3b-b7217641c654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba5588e-2f81-4085-8d34-273c760203d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba5588e-2f81-4085-8d34-273c760203d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bf9743b-5a00-4801-aad1-728e80aaf095', 'volume_name': 'volume-1bf9743b-5a00-4801-aad1-728e80aaf095', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466db38f-7e1e-4937-9670-d427d931f4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466db38f-7e1e-4937-9670-d427d931f4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774bb2cc-81c1-4a10-9d6e-31dd483ac275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:15 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Volume 1bf9743b-5a00-4801-aad1-728e80aaf095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bf9743b-5a00-4801-aad1-728e80aaf095', 'volume_size': 1} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1574686623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf9743b-5a00-4801-aad1-728e80aaf095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27f2a7360484eb08a7eb47679b96a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:15Z,use_quota=True,user_id='5175a693752f4986b025bfa994b6e6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Creating volume 1bf9743b-5a00-4801-aad1-728e80aaf095 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:15 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1bf9743b-5a00-4801-aad1-728e80aaf095 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:15 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1bf9743b-5a00-4801-aad1-728e80aaf095 1073741824 Jul 15 18:49:15 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-52bb4bb3-68fa-4731-88fb-422f3f39ec9f-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Lock "cinder-52bb4bb3-68fa-4731-88fb-422f3f39ec9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-52bb4bb3-68fa-4731-88fb-422f3f39ec9f" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-52bb4bb3-68fa-4731-88fb-422f3f39ec9f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Deleting offline snapshot 52bb4bb3-68fa-4731-88fb-422f3f39ec9f of volume a51ddf4d-be28-4b7b-b1d0-7654f7923d4b {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] snapshot_file for this snap is: volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[c390969f-d17a-4e12-937d-86372864d13d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:15 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1bf9743b-5a00-4801-aad1-728e80aaf095 1073741824" returned: 0 in 0.461s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:15 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f Jul 15 18:49:15 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:15 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1bf9743b-5a00-4801-aad1-728e80aaf095 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:16 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1bf9743b-5a00-4801-aad1-728e80aaf095 Jul 15 18:49:16 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:16 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f" returned: 0 in 0.373s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:16 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1bf9743b-5a00-4801-aad1-728e80aaf095" returned: 0 in 0.274s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774bb2cc-81c1-4a10-9d6e-31dd483ac275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bf9743b-5a00-4801-aad1-728e80aaf095', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6758ad13-8686-4162-8450-91a6c5d359ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef34f0bf-98bf-4137-9366-e47c8dd416ec]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:16 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Volume volume-1bf9743b-5a00-4801-aad1-728e80aaf095 (1bf9743b-5a00-4801-aad1-728e80aaf095): created successfully Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6758ad13-8686-4162-8450-91a6c5d359ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Flow 'volume_create_manager' (13c9655b-55a3-4d4f-8a2e-8cbe944a54a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:16 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7b10603a-2874-48e4-8dc7-ce5c64820b0f tempest-ProjectReaderTests-1999097005 None] Created volume successfully. Jul 15 18:49:16 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b Jul 15 18:49:16 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:16 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b" returned: 0 in 0.368s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:16 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f Jul 15 18:49:16 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:16 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f" returned: 0 in 0.330s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:16 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:17 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f Jul 15 18:49:17 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:17 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b.52bb4bb3-68fa-4731-88fb-422f3f39ec9f" returned: 0 in 0.253s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-52bb4bb3-68fa-4731-88fb-422f3f39ec9f" released by "_delete_snapshot" :: held 1.438s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b" released by "delete_snapshot" :: held 1.461s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Created reservations ['99dd71eb-1f5f-4a80-a19c-4b7486d8cac2', '145a6fc9-e4ac-42f6-882a-118e45580397', '9df2cc78-7be1-431b-8d3a-95adff97973d', '18050c6b-ec50-44e1-b5e2-cc78f03def95'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:17 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Delete snapshot completed successfully. Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-7899e959-c45f-481a-b5e9-1dab9dfea279 tempest-ProjectMemberTests-529349186 None] Lock "cinder-52bb4bb3-68fa-4731-88fb-422f3f39ec9f-delete_snapshot" released by "delete_snapshot" :: held 1.602s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Acquiring lock "cinder-1bf9743b-5a00-4801-aad1-728e80aaf095-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Lock "cinder-1bf9743b-5a00-4801-aad1-728e80aaf095-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Acquiring lock "cinder-quobyte-1bf9743b-5a00-4801-aad1-728e80aaf095" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Lock "cinder-quobyte-1bf9743b-5a00-4801-aad1-728e80aaf095" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[235a45a4-830a-42ec-ad0a-99b269e6b868]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1bf9743b-5a00-4801-aad1-728e80aaf095 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:17 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1bf9743b-5a00-4801-aad1-728e80aaf095 Jul 15 18:49:17 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:17 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1bf9743b-5a00-4801-aad1-728e80aaf095" returned: 0 in 0.388s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1bf9743b-5a00-4801-aad1-728e80aaf095 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:17 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Lock "cinder-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:17 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1bf9743b-5a00-4801-aad1-728e80aaf095 Jul 15 18:49:17 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b" acquired by "delete_volume" :: waited 0.018s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef38344-8e9a-4ea6-bd31-c5eaac270773]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:18 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b Jul 15 18:49:18 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:18 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-1bf9743b-5a00-4801-aad1-728e80aaf095" returned: 0 in 0.272s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Lock "cinder-quobyte-1bf9743b-5a00-4801-aad1-728e80aaf095" released by "delete_volume" :: held 0.707s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Created reservations ['c6524614-c833-4ea9-bb3a-179a0bbf678d', '182c5d83-a562-4e0a-9c0f-f3ae0a93e208', '4b77058f-34ef-40a7-a5f2-ddfa4a12a98b', 'e7e3c1d9-1211-47ef-84ae-7b300bd1cf98'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:18 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:49:18 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:18 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b" returned: 0 in 0.374s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:18 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b Jul 15 18:49:18 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:18 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.271s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:18 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Deleted volume successfully. Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-1b3b166f-a7bc-4503-ae27-d9b3c787c877 tempest-ProjectReaderTests-1999097005 None] Lock "cinder-1bf9743b-5a00-4801-aad1-728e80aaf095-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:18 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b" returned: 0 in 0.265s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b" released by "delete_volume" :: held 0.696s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Created reservations ['ed86db61-f911-4f6c-8191-0ba27e86fb94', '5d77bf80-a123-49e2-941e-68735ae87353', 'b59a09f7-7d6d-4ea1-811d-e9cd9eb80124', 'f20f0a54-8fbe-4f72-9975-6c42ec83a5f6'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:18 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:18 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:49:18 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:19 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.262s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:19 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Deleted volume successfully. Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Flow 'volume_create_manager' (3f396457-d2fe-4141-9655-22c824ca0dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c11d169-b74c-482c-a24e-65b414c0005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c11d169-b74c-482c-a24e-65b414c0005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111501745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27f2a7360484eb08a7eb47679b96a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:19Z,use_quota=True,user_id='5175a693752f4986b025bfa994b6e6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915114e6-0724-4bf0-b305-9a4e03e36344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915114e6-0724-4bf0-b305-9a4e03e36344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494c46da-9842-4a48-8cfc-a22511832718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494c46da-9842-4a48-8cfc-a22511832718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f', 'volume_name': 'volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85958157-e8d7-4633-9b46-2b3d7e6da28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85958157-e8d7-4633-9b46-2b3d7e6da28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb845898-8ad5-4a18-882b-4cb9026a9905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:19 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Volume 3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f', 'volume_size': 1} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111501745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27f2a7360484eb08a7eb47679b96a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:19Z,use_quota=True,user_id='5175a693752f4986b025bfa994b6e6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Creating volume 3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:19 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-154c8019-7426-4e15-a9a1-7e606ff3e285 tempest-ProjectMemberTests-529349186 None] Lock "cinder-a51ddf4d-be28-4b7b-b1d0-7654f7923d4b-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:19 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f 1073741824 Jul 15 18:49:19 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (4fadb3af-f499-4036-802c-0e20e7027b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4681cd-e9e1-4d67-b955-f88d3acdb1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4681cd-e9e1-4d67-b955-f88d3acdb1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723186860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee4aa26-af3e-46c7-a280-6e70756f4181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:20Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba939e85-a98c-458e-a818-f3fd084a7e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba939e85-a98c-458e-a818-f3fd084a7e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcaf01e-cb2c-4ed6-83df-08ad0fed1262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcaf01e-cb2c-4ed6-83df-08ad0fed1262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee4aa26-af3e-46c7-a280-6e70756f4181', 'volume_name': 'volume-cee4aa26-af3e-46c7-a280-6e70756f4181', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032b91d5-cee2-4f4e-899c-4c37df426909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032b91d5-cee2-4f4e-899c-4c37df426909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72213fca-c1a1-4c53-97e1-d9f168de08ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:19 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Volume cee4aa26-af3e-46c7-a280-6e70756f4181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee4aa26-af3e-46c7-a280-6e70756f4181', 'volume_size': 1} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:19 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f 1073741824" returned: 0 in 0.463s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:19 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f Jul 15 18:49:19 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:19 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f" returned: 0 in 0.246s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.307s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723186860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee4aa26-af3e-46c7-a280-6e70756f4181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8fce5546d74342b7b3317a5a699e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:20Z,use_quota=True,user_id='094b00aba4544f90b61b45c897a80589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Creating volume cee4aa26-af3e-46c7-a280-6e70756f4181 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:19 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:49:19 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb845898-8ad5-4a18-882b-4cb9026a9905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:20 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 1073741824 Jul 15 18:49:20 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d80b79-8864-4459-8568-5fae365a1b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:20 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Volume volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f (3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f): created successfully Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d80b79-8864-4459-8568-5fae365a1b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Flow 'volume_create_manager' (3f396457-d2fe-4141-9655-22c824ca0dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:20 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-fc972185-122f-4070-a3f1-89cc6bc3536b tempest-ProjectReaderTests-1999097005 None] Created volume successfully. Jul 15 18:49:20 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 1073741824" returned: 0 in 0.410s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:20 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 Jul 15 18:49:20 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:20 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181" returned: 0 in 0.247s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72213fca-c1a1-4c53-97e1-d9f168de08ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee4aa26-af3e-46c7-a280-6e70756f4181', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c8569e-14a0-458e-8c59-174aa4671a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:20 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Volume volume-cee4aa26-af3e-46c7-a280-6e70756f4181 (cee4aa26-af3e-46c7-a280-6e70756f4181): created successfully Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c8569e-14a0-458e-8c59-174aa4671a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:20 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Flow 'volume_create_manager' (4fadb3af-f499-4036-802c-0e20e7027b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:20 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-ef1ada1e-adb8-494c-b4c2-730e03059055 tempest-ProjectMemberTests-529349186 None] Created volume successfully. Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Acquiring lock "cinder-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Lock "cinder-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Acquiring lock "cinder-quobyte-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Lock "cinder-quobyte-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f" acquired by "delete_volume" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1667bb7-bb0e-4cdc-869a-b2704046567a]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:21 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f Jul 15 18:49:21 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:21 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f" returned: 0 in 0.373s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:21 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f Jul 15 18:49:21 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=296,cinder:SELECT=215,cinder:DELETE=24,cinder:INSERT=80 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] Creating offline snapshot f0222722-8990-46fb-a272-dc60a70b7d16 of volume cee4aa26-af3e-46c7-a280-6e70756f4181 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd16306-03ac-4adb-8eb1-418883eaed0b]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:21 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f" returned: 0 in 0.266s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Lock "cinder-quobyte-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f" released by "delete_volume" :: held 0.678s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:21 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:DELETE=23,cinder:SELECT=208,cinder:INSERT=78,cinder:UPDATE=277 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:49:21 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 Jul 15 18:49:21 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Created reservations ['26352e70-f7a6-4fd2-83c8-4ef69dcddb4c', '94025db6-c08f-4362-9596-e69206ac44eb', '65874894-adb4-4260-972f-d6ada3d487b2', '61d5cf1c-6e62-42a6-a86b-0ca9dec156e7'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:22 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:49:22 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:22 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181" returned: 0 in 0.386s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:22 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 1G Jul 15 18:49:22 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:22 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.274s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:22 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Deleted volume successfully. Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-2f2c418d-6e50-4a6a-a3f3-4705760406ee tempest-ProjectReaderTests-1999097005 None] Lock "cinder-3ff2b123-20a2-4b39-8a92-ad7ad5a90b1f-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:22 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 1G" returned: 0 in 0.447s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cee4aa26-af3e-46c7-a280-6e70756f4181 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:22 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cee4aa26-af3e-46c7-a280-6e70756f4181 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 Jul 15 18:49:22 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Flow 'volume_create_manager' (c12bbd1d-f071-40d5-85f8-ed83d50350d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62abc675-4566-4321-896a-7fb455ed3b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62abc675-4566-4321-896a-7fb455ed3b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1477252576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce4e448-3bb6-48de-997f-8c6b2dc92965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27f2a7360484eb08a7eb47679b96a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:23Z,use_quota=True,user_id='5175a693752f4986b025bfa994b6e6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87694cd7-6383-4741-8638-e1aef55afae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87694cd7-6383-4741-8638-e1aef55afae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc5b0e4-bbd3-425f-a942-e755a6631813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc5b0e4-bbd3-425f-a942-e755a6631813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce4e448-3bb6-48de-997f-8c6b2dc92965', 'volume_name': 'volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b1480a-cde4-4946-9a61-a594cc6ad622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b1480a-cde4-4946-9a61-a594cc6ad622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e87e58-abf3-4a6a-bc94-345117a07add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:22 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Volume 5ce4e448-3bb6-48de-997f-8c6b2dc92965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965', 'volume_size': 1} Jul 15 18:49:22 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:23 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cee4aa26-af3e-46c7-a280-6e70756f4181 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16" returned: 0 in 0.312s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:23 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 is being set with open permissions: ugo+rw Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:23 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 Jul 15 18:49:23 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:23 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16" returned: 0 in 0.249s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:23 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.info Jul 15 18:49:23 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:23 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.info" returned: 0 in 0.251s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:23 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.info is being set with open permissions: ugo+rw Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:23 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.info Jul 15 18:49:23 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:23 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.info" returned: 0 in 0.247s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1477252576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce4e448-3bb6-48de-997f-8c6b2dc92965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d27f2a7360484eb08a7eb47679b96a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:23Z,use_quota=True,user_id='5175a693752f4986b025bfa994b6e6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Creating volume 5ce4e448-3bb6-48de-997f-8c6b2dc92965 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:23 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:49:23 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:23 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965 1073741824 Jul 15 18:49:23 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:23 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-de63b422-abc5-4ff1-8eef-548eca586940 tempest-ProjectMemberTests-529349186 None] Create snapshot completed successfully Jul 15 18:49:24 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965 1073741824" returned: 0 in 0.403s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:24 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965 Jul 15 18:49:24 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:24 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965" returned: 0 in 0.236s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:24 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:49:24 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e87e58-abf3-4a6a-bc94-345117a07add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4978aa9-eb36-4206-9af5-6a36cba8b567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:24 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Volume volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965 (5ce4e448-3bb6-48de-997f-8c6b2dc92965): created successfully Jul 15 18:49:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4978aa9-eb36-4206-9af5-6a36cba8b567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:24 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Flow 'volume_create_manager' (c12bbd1d-f071-40d5-85f8-ed83d50350d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:24 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-15f21415-f3c0-4d88-bef7-e6494799f43a tempest-ProjectReaderTests-1999097005 None] Created volume successfully. Jul 15 18:49:24 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Acquiring lock "cinder-5ce4e448-3bb6-48de-997f-8c6b2dc92965-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Lock "cinder-5ce4e448-3bb6-48de-997f-8c6b2dc92965-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Acquiring lock "cinder-quobyte-5ce4e448-3bb6-48de-997f-8c6b2dc92965" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Lock "cinder-quobyte-5ce4e448-3bb6-48de-997f-8c6b2dc92965" acquired by "delete_volume" :: waited 0.013s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e4244f-77d5-4505-a7cd-f94b38e5f9bf]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-f0222722-8990-46fb-a272-dc60a70b7d16-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Lock "cinder-f0222722-8990-46fb-a272-dc60a70b7d16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-cee4aa26-af3e-46c7-a280-6e70756f4181" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-cee4aa26-af3e-46c7-a280-6e70756f4181" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-f0222722-8990-46fb-a272-dc60a70b7d16" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-f0222722-8990-46fb-a272-dc60a70b7d16" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Deleting offline snapshot f0222722-8990-46fb-a272-dc60a70b7d16 of volume cee4aa26-af3e-46c7-a280-6e70756f4181 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] snapshot_file for this snap is: volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[b976425b-8f64-4f3e-b5ec-07764567e27e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:25 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965 Jul 15 18:49:25 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:25 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 Jul 15 18:49:25 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:25 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965" returned: 0 in 0.368s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:25 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965 Jul 15 18:49:25 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:25 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16" returned: 0 in 0.373s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cee4aa26-af3e-46c7-a280-6e70756f4181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[858281d8-f2c6-4070-92a1-9d60e9098626]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:25 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-5ce4e448-3bb6-48de-997f-8c6b2dc92965" returned: 0 in 0.256s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Lock "cinder-quobyte-5ce4e448-3bb6-48de-997f-8c6b2dc92965" released by "delete_volume" :: held 0.669s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:25 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 Jul 15 18:49:25 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Created reservations ['e45a04f9-3104-40a7-ba99-fdb0a7e5d8c9', 'df209ac3-aa9a-4f10-9bba-4106e027748a', '54a61d7f-2752-457d-a0bc-62798806326d', '0570fd4d-9695-4352-aa3b-b5e75c5e390d'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:25 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:49:25 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:25 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181" returned: 0 in 0.353s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:25 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:25 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 Jul 15 18:49:25 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:26 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.260s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:26 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:26 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Deleted volume successfully. Jul 15 18:49:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-e751ba8e-3593-42f4-ae73-244f1cc3f874 tempest-ProjectReaderTests-1999097005 None] Lock "cinder-5ce4e448-3bb6-48de-997f-8c6b2dc92965-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:26 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16" returned: 0 in 0.369s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:26 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16 Jul 15 18:49:26 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:26 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:26 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181.f0222722-8990-46fb-a272-dc60a70b7d16" returned: 0 in 0.247s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-f0222722-8990-46fb-a272-dc60a70b7d16" released by "_delete_snapshot" :: held 1.436s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-cee4aa26-af3e-46c7-a280-6e70756f4181" released by "delete_snapshot" :: held 1.458s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:26 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Created reservations ['7b3c75e9-a998-4b1d-b10c-1598bdd79164', '4b410c78-b04f-4f59-90bf-3fc968588bf9', '94e0c379-3878-41b1-a9b1-39bdf4bf9b4b', 'fc1c1f7b-cbd5-40ad-a649-4997ece0499a'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:26 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Delete snapshot completed successfully. Jul 15 18:49:26 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-fe87b4af-c083-4151-aac5-9a85c409f6ac tempest-ProjectMemberTests-529349186 None] Lock "cinder-f0222722-8990-46fb-a272-dc60a70b7d16-delete_snapshot" released by "delete_snapshot" :: held 1.604s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-cee4aa26-af3e-46c7-a280-6e70756f4181-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Lock "cinder-cee4aa26-af3e-46c7-a280-6e70756f4181-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Acquiring lock "cinder-quobyte-cee4aa26-af3e-46c7-a280-6e70756f4181" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:49:27 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-cee4aa26-af3e-46c7-a280-6e70756f4181" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:49:27 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d15a8e-e8e8-4de4-b079-1039b49ceafb]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:49:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:27 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 Jul 15 18:49:27 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:27 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181" returned: 0 in 0.413s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:27 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:27 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181 Jul 15 18:49:27 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:28 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-cee4aa26-af3e-46c7-a280-6e70756f4181" returned: 0 in 0.268s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Lock "cinder-quobyte-cee4aa26-af3e-46c7-a280-6e70756f4181" released by "delete_volume" :: held 0.745s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:28 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Created reservations ['a8a42166-c28f-47b6-9084-5c42dfa70350', '4fb73d60-0b4b-4e7c-82c0-f2b308086778', 'ebe2494d-7325-4cc6-a230-08a577bf488f', 'ab78a1b9-b17f-4c89-aebc-19baaa85a4b0'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:49:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:28 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:28 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:49:28 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:28 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:28 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.250s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:28 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:28 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Deleted volume successfully. Jul 15 18:49:28 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-4da6bd63-4853-4562-8e33-1d0118910fc9 tempest-ProjectMemberTests-529349186 None] Lock "cinder-cee4aa26-af3e-46c7-a280-6e70756f4181-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:49:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:49:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:32 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:49:32 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:49:32 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 15 18:49:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.273s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:49:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:49:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:49:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:49:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 15 18:49:38 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=35,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:49:38 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=23,cinder:INSERT=12,cinder:UPDATE=32,cinder:DELETE=4 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Flow 'volume_create_manager' (f7d50016-29da-4af3-b41e-bf722c038372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fe3a4e-cdfa-4fb4-9ccd-9b39fb3969e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fe3a4e-cdfa-4fb4-9ccd-9b39fb3969e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-662660374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0249e46-b22b-44ad-b081-1ea490946406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a90e21de0d4ae8a1436f84896519d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:59Z,use_quota=True,user_id='687bc5c61e2b45898b99a07e2d440000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af088aae-4c01-48bf-a72d-b1b846224a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af088aae-4c01-48bf-a72d-b1b846224a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940481a5-fe95-4247-8f94-dc4bbe3a0ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940481a5-fe95-4247-8f94-dc4bbe3a0ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0249e46-b22b-44ad-b081-1ea490946406', 'volume_name': 'volume-a0249e46-b22b-44ad-b081-1ea490946406', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98a284f-2cf6-40ab-8e31-a5ef545e3280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98a284f-2cf6-40ab-8e31-a5ef545e3280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96e9e36-13b2-4227-8892-180a996977a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:49:59 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Volume a0249e46-b22b-44ad-b081-1ea490946406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0249e46-b22b-44ad-b081-1ea490946406', 'volume_size': 1} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-662660374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0249e46-b22b-44ad-b081-1ea490946406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a90e21de0d4ae8a1436f84896519d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:49:59Z,use_quota=True,user_id='687bc5c61e2b45898b99a07e2d440000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)}" {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Creating volume a0249e46-b22b-44ad-b081-1ea490946406 {{(pid=87217) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:49:59 devstack cinder-volume[87217]: INFO cinder.volume.drivers.remotefs [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] casted to osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d Jul 15 18:49:59 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 1073741824 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:49:59 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 1073741824 Jul 15 18:49:59 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:00 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 1073741824" returned: 0 in 0.405s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:00 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 Jul 15 18:50:00 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:00 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406" returned: 0 in 0.230s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'} {{(pid=87217) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96e9e36-13b2-4227-8892-180a996977a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0249e46-b22b-44ad-b081-1ea490946406', 'volume_size': 1}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d5c16e-17f5-45ff-a915-64287043a5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:00 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Volume volume-a0249e46-b22b-44ad-b081-1ea490946406 (a0249e46-b22b-44ad-b081-1ea490946406): created successfully Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d5c16e-17f5-45ff-a915-64287043a5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Flow 'volume_create_manager' (f7d50016-29da-4af3-b41e-bf722c038372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:00 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-60a63ea2-96c2-44fd-ac08-d982cafbef3f tempest-SnapshotDependencyTests-1186781565 None] Created volume successfully. Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] Creating offline snapshot 68740bbf-8efb-4dc9-b363-4ffa9fbf81cd of volume a0249e46-b22b-44ad-b081-1ea490946406 {{(pid=87217) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a1ec90-b3ec-4112-af4f-e5d97108083d]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:00 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:00 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 Jul 15 18:50:00 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:01 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406" returned: 0 in 0.341s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd 1G {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:01 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd 1G Jul 15 18:50:01 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:01 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd 1G" returned: 0 in 0.382s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0249e46-b22b-44ad-b081-1ea490946406 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:01 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0249e46-b22b-44ad-b081-1ea490946406 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd Jul 15 18:50:01 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:01 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0249e46-b22b-44ad-b081-1ea490946406 -F qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd" returned: 0 in 0.285s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:01 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd is being set with open permissions: ugo+rw Jul 15 18:50:01 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:01 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd Jul 15 18:50:01 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:02 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd" returned: 0 in 0.239s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:02 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.info Jul 15 18:50:02 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:02 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.info" returned: 0 in 0.244s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:02 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.info is being set with open permissions: ugo+rw Jul 15 18:50:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.info {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:02 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.info Jul 15 18:50:02 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:02 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.info" returned: 0 in 0.238s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:02 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.810s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:02 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-8cc3880d-de0e-44e5-94dc-103efdf69c41 tempest-SnapshotDependencyTests-1186781565 None] Create snapshot completed successfully Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87217) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Flow 'volume_create_manager' (e24c6572-0e77-4944-ae49-48a39afdffdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598b037a-0bcb-48c3-abe4-b43d82fb3738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598b037a-0bcb-48c3-abe4-b43d82fb3738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-15T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f05c2ef-5a75-459d-ab53-b4bd7e2e4770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a90e21de0d4ae8a1436f84896519d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-15T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68740bbf-8efb-4dc9-b363-4ffa9fbf81cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-15T16:50:03Z,use_quota=True,user_id='687bc5c61e2b45898b99a07e2d440000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d133b5-467e-43bc-8892-42e1ad77aa4c),volume_type_id=66d133b5-467e-43bc-8892-42e1ad77aa4c)' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46dcbdca-a9d9-4da7-afa0-8002e0ba6925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46dcbdca-a9d9-4da7-afa0-8002e0ba6925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d629dff-7c3c-492a-b505-14be09efdcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d629dff-7c3c-492a-b505-14be09efdcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f05c2ef-5a75-459d-ab53-b4bd7e2e4770', 'volume_name': 'volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770', 'volume_size': 1, 'snapshot_id': '68740bbf-8efb-4dc9-b363-4ffa9fbf81cd'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54748128-228a-43f0-a3eb-90b88985b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54748128-228a-43f0-a3eb-90b88985b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20b615b-8c21-46d7-b649-b8441ab7a05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:03 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Volume 4f05c2ef-5a75-459d-ab53-b4bd7e2e4770: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770', 'volume_size': 1, 'snapshot_id': '68740bbf-8efb-4dc9-b363-4ffa9fbf81cd'} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "cinder-quobyte-68740bbf-8efb-4dc9-b363-4ffa9fbf81cd-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" by "_create_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-quobyte-68740bbf-8efb-4dc9-b363-4ffa9fbf81cd-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Creating volume 4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 from snapshot 68740bbf-8efb-4dc9-b363-4ffa9fbf81cd {{(pid=87217) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Selected osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d as target Quobyte volume. {{(pid=87217) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "cinder-quobyte-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" by "_copy_volume_from_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-quobyte-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] snapshot: 68740bbf-8efb-4dc9-b363-4ffa9fbf81cd, volume: 4f05c2ef-5a75-459d-ab53-b4bd7e2e4770, {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8e4076-0eac-40a2-ae46-ddbb367e09d9]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:03 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd Jul 15 18:50:03 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:03 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd" returned: 0 in 0.352s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0249e46-b22b-44ad-b081-1ea490946406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Creating direct copy from snapshot {{(pid=87217) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf45420-dc32-4396-be69-9d7db49d21b4]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:03 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:04 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 Jul 15 18:50:04 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:04 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406" returned: 0 in 0.331s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:04 devstack cinder-volume[87217]: DEBUG cinder.utils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Path /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 not found in is_blk_device check {{(pid=87217) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 15 18:50:04 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:04 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 Jul 15 18:50:04 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:07 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" returned: 0 in 3.716s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:07 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[f763ee51-f22d-4fa7-8ad7-55990d49389e]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:07 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:08 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 Jul 15 18:50:08 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:08 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406" returned: 0 in 0.494s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.image.image_utils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406, size 1024.00 MB, duration 3.72 sec, destination /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 {{(pid=87217) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 15 18:50:08 devstack cinder-volume[87217]: INFO cinder.image.image_utils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Converted 1024.00 MB image at 275.51 MB/s Jul 15 18:50:08 devstack cinder-volume[87217]: WARNING cinder.volume.drivers.remotefs [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 is being set with open permissions: ugo+rw Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:08 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 Jul 15 18:50:08 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:08 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" returned: 0 in 0.228s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-quobyte-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" released by "_copy_volume_from_snapshot" :: held 5.199s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-quobyte-68740bbf-8efb-4dc9-b363-4ffa9fbf81cd-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" released by "_create_volume_from_snapshot" :: held 5.226s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.240s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20b615b-8c21-46d7-b649-b8441ab7a05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770', 'volume_size': 1, 'snapshot_id': '68740bbf-8efb-4dc9-b363-4ffa9fbf81cd'}' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4586bdb-9cb2-41ab-8f4e-7aa6586c6507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 15 18:50:08 devstack cinder-volume[87217]: INFO cinder.volume.flows.manager.create_volume [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Volume volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 (4f05c2ef-5a75-459d-ab53-b4bd7e2e4770): created successfully Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4586bdb-9cb2-41ab-8f4e-7aa6586c6507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87217) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Flow 'volume_create_manager' (e24c6572-0e77-4944-ae49-48a39afdffdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87217) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 15 18:50:08 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-c3f6aa4a-7c6f-45a3-8af1-519e65a6da00 tempest-SnapshotDependencyTests-1186781565 None] Created volume successfully. Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "cinder-68740bbf-8efb-4dc9-b363-4ffa9fbf81cd-delete_snapshot" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-68740bbf-8efb-4dc9-b363-4ffa9fbf81cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "cinder-quobyte-a0249e46-b22b-44ad-b081-1ea490946406" by "delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-quobyte-a0249e46-b22b-44ad-b081-1ea490946406" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "cinder-quobyte-68740bbf-8efb-4dc9-b363-4ffa9fbf81cd" by "_delete_snapshot" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:08 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-quobyte-68740bbf-8efb-4dc9-b363-4ffa9fbf81cd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Deleting offline snapshot 68740bbf-8efb-4dc9-b363-4ffa9fbf81cd of volume a0249e46-b22b-44ad-b081-1ea490946406 {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 15 18:50:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] snapshot_file for this snap is: volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd {{(pid=87217) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 15 18:50:09 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[394ed4d1-f935-402c-95f8-3bc808d5abc1]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:09 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd Jul 15 18:50:09 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:09 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd" returned: 0 in 0.355s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:09 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.remotefs [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0249e46-b22b-44ad-b081-1ea490946406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87217) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 15 18:50:09 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[880c8fae-4b45-4335-8cf0-73eda6238b16]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:09 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 Jul 15 18:50:09 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:09 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406" returned: 0 in 0.348s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:09 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:09 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd Jul 15 18:50:09 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:10 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd" returned: 0 in 0.317s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:10 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd Jul 15 18:50:10 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:10 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:10 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406.68740bbf-8efb-4dc9-b363-4ffa9fbf81cd" returned: 0 in 0.232s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-quobyte-68740bbf-8efb-4dc9-b363-4ffa9fbf81cd" released by "_delete_snapshot" :: held 1.345s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-quobyte-a0249e46-b22b-44ad-b081-1ea490946406" released by "delete_snapshot" :: held 1.371s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:10 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Created reservations ['d2e0810e-1697-4ae5-acd6-59f651beb653', '0263bd59-5171-4c02-8668-aba1f1c44ddc', '42b460b0-099c-44a3-8f4b-0c3ae5028169', '4435f5e9-f83e-4b25-8aed-f73f04b2c856'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:10 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Delete snapshot completed successfully. Jul 15 18:50:10 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-0936baad-7797-4f2e-bff7-4d1a53f87fa8 tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-68740bbf-8efb-4dc9-b363-4ffa9fbf81cd-delete_snapshot" released by "delete_snapshot" :: held 1.498s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "cinder-a0249e46-b22b-44ad-b081-1ea490946406-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-a0249e46-b22b-44ad-b081-1ea490946406-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "cinder-quobyte-a0249e46-b22b-44ad-b081-1ea490946406" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-quobyte-a0249e46-b22b-44ad-b081-1ea490946406" acquired by "delete_volume" :: waited 0.015s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d983ce-9d34-42d4-871f-0b91bcc48639]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:11 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 Jul 15 18:50:11 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:11 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406" returned: 0 in 0.348s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:11 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406 Jul 15 18:50:11 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:11 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-a0249e46-b22b-44ad-b081-1ea490946406" returned: 0 in 0.253s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-quobyte-a0249e46-b22b-44ad-b081-1ea490946406" released by "delete_volume" :: held 0.653s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Created reservations ['0b343f91-b5ef-4939-b303-5823575366f2', '1ece8781-775c-45c5-85bd-bcab1ea621d5', '2f13268d-3365-44bc-a487-b8790d778620', '52f7b8a1-133b-45c2-b2d4-7873ed75a654'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:11 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:12 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:50:12 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:12 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.268s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:12 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Deleted volume successfully. Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "cinder-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770-delete_volume" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-a6a7a344-e8a2-4c6e-a942-bbddce4c41cb tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-a0249e46-b22b-44ad-b081-1ea490946406-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "cinder-quobyte-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" by "delete_volume" {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-quobyte-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" acquired by "delete_volume" :: waited 0.014s {{(pid=87217) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG oslo.privsep.daemon [-] privsep: reply[2160ad38-b103-4f31-808a-c984e495cda1]: (4, 'qcow2') {{(pid=88632) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:12 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 Jul 15 18:50:12 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:12 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" returned: 0 in 0.344s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:12 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770 Jul 15 18:50:12 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:12 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0/volume-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" returned: 0 in 0.244s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:12 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-quobyte-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770" released by "delete_volume" :: held 0.624s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:13 devstack cinder-volume[87217]: DEBUG cinder.quota [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Created reservations ['b1563c28-eec9-4eba-9048-7745358f8186', 'ba5c3f94-86dc-4976-9238-594e409dc74c', '40752f80-5e2a-4df2-af53-fd0d0ec54788', '7c1a7ef9-40fa-40cf-9de8-946a50dd017a'] {{(pid=87217) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 15 18:50:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:13 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:13 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:50:13 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:13 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:13 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.248s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:13 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:13 devstack cinder-volume[87217]: INFO cinder.volume.manager [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Deleted volume successfully. Jul 15 18:50:13 devstack cinder-volume[87217]: DEBUG cinder.coordination [None req-3c50f71d-1459-44f8-8080-4c875f86c71e tempest-SnapshotDependencyTests-1186781565 None] Lock "cinder-4f05c2ef-5a75-459d-ab53-b4bd7e2e4770-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87217) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 15 18:50:23 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:50:23 devstack cinder-volume[87217]: DEBUG dbcounter [-] [87217] Writing DB stats cinder:UPDATE=28,cinder:SELECT=23,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 15 18:50:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:50:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 15 18:50:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 15 18:50:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d': None} {{(pid=87217) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 15 18:50:32 devstack cinder-volume[87217]: DEBUG cinder.volume.drivers.quobyte [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26273800-f5d9-4497-b7eb-590d4efdb60d'] {{(pid=87217) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 15 18:50:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.lockutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87217) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 15 18:50:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 15 18:50:32 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0 Jul 15 18:50:32 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 15 18:50:32 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Jul 15 18:50:32 devstack cinder-volume[87217]: DEBUG oslo_concurrency.processutils [None req-da381713-5a49-491a-8954-afb64e022d14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f9c3d7271ddb0a770fc112e314fa7e0" returned: 0 in 0.250s {{(pid=87217) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 15 18:50:32 devstack cinder-volume[87217]: DEBUG cinder.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Notifying Schedulers of capabilities ... {{(pid=87217) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 15 18:50:32 devstack cinder-volume[87217]: DEBUG oslo_service.periodic_task [None req-da381713-5a49-491a-8954-afb64e022d14 None None] Running periodic task VolumeManager._thread_info {{(pid=87217) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 15 18:50:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread count: 28 {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 15 18:50:32 devstack cinder-volume[87217]: DEBUG cinder.volume.manager [None req-da381713-5a49-491a-8954-afb64e022d14 None None] thread info: [<_MainThread(MainThread, started 136802243797120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87217) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}